-- Logs begin at Wed 2022-09-07 13:54:59 UTC, end at Wed 2022-09-07 15:02:53 UTC. -- Sep 07 14:36:53.364427 dv-cinder-801354-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 14:36:53.374856 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 14:36:53 2022] *** Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: nodename: dv-cinder-801354-8-iscsi Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: machine: x86_64 Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: clock source: unix Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: pcre jit disabled Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: detected number of CPU cores: 4 Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: current working directory: / Sep 07 14:36:53.376878 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: detected binary path: /usr/bin/uwsgi-core Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: your processes number limit is 47680 Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: your memory page size is 4096 bytes Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: detected max file descriptor number: 2048 Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: lock engine: pthread robust mutexes Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: thunder lock: enabled Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 14:36:53.377583 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 14:36:53.416795 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: Python main interpreter initialized at 0x564a1b3749c0 Sep 07 14:36:53.416795 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: python threads support enabled Sep 07 14:36:53.416795 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: your server socket listen backlog is limited to 100 connections Sep 07 14:36:53.416795 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: your mercy for graceful operations on workers is 90 seconds Sep 07 14:36:53.417112 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 14:36:53.417208 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: *** Operational MODE: preforking *** Sep 07 14:36:53.417467 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: *** uWSGI is running in multiple interpreter mode *** Sep 07 14:36:53.417467 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: spawned uWSGI master process (pid: 112505) Sep 07 14:36:53.417647 dv-cinder-801354-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 14:36:53.418531 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: spawned uWSGI worker 1 (pid: 112506, cores: 1) Sep 07 14:36:53.418531 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: spawned uWSGI worker 2 (pid: 112507, cores: 1) Sep 07 14:36:53.418699 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 14:36:54.077763 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 14:36:54.078356 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 14:36:55.168888 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:36:55.168888 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: from cryptography.utils import int_from_bytes Sep 07 14:36:55.169468 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:36:55.169468 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: from cryptography.utils import int_from_bytes Sep 07 14:36:55.169849 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:36:55.169849 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: from cryptography.utils import int_from_bytes Sep 07 14:36:55.170011 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:36:55.170011 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: from cryptography.utils import int_from_bytes Sep 07 14:36:57.658822 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:36:57.659514 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:36:57.659873 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:36:57.659962 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:36:57.659962 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:36:57.660161 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:36:57.660161 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:36:57.660309 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:36:57.660387 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:36:57.660478 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:36:57.660565 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.660644 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.660852 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.660943 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661170 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661281 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661484 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661578 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661809 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.661906 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662115 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662203 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662511 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662740 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.662834 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663063 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663148 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663320 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663404 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663629 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663725 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.663947 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-8-iscsi {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664048 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-8-iscsi {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664288 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664387 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664586 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664690 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664890 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.664983 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665200 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665294 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665501 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665596 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665817 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.665902 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.666111 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.666196 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.666606 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.666731 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.667755 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.667897 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668007 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668104 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668221 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668360 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668452 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668539 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668624 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668717 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668802 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668889 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.668969 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669094 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669183 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669277 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669432 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669518 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669732 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.669823 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.670121 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-8-iscsi {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.670312 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-8-iscsi {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671024 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671122 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671343 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671439 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671648 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.671776 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672052 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672225 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672393 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672534 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672697 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.672791 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673011 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673096 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673324 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673411 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673724 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.673946 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674030 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674277 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674401 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674571 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674658 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674881 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.674973 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675176 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675350 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675479 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675564 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675787 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.675874 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676099 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676216 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676423 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676580 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676723 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676810 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.676966 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677059 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677267 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677360 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677580 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677665 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677894 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.677986 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678208 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678295 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678456 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678544 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678698 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.678785 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679007 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679094 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679321 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679418 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679622 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679707 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.679922 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680016 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680243 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680346 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680546 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680633 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680845 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.680931 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681143 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681230 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681443 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681532 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681744 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.681865 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682053 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682139 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682361 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682446 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682674 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682758 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.682975 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683061 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683286 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683369 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683673 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683757 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.683919 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684010 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684239 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684342 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684577 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684669 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684889 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.684975 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685194 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685280 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685503 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685597 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685820 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.685908 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686142 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686234 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686443 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686539 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686743 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.686831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687053 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687136 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687380 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687479 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687679 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687766 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.687926 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688017 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688238 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688341 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688536 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688622 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688849 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.688943 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689147 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689232 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689446 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689532 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689745 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.689836 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690036 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690120 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690335 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690419 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690630 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690720 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.690928 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691014 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691225 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691309 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691522 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691611 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691820 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.691907 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692117 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692222 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692520 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692731 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.692825 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693026 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693113 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693337 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693431 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693649 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693742 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.693947 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694040 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694243 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694337 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694539 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694689 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694836 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.694922 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695147 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695239 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695447 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695533 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695750 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.695837 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696063 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696233 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696381 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696476 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696678 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696817 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.696988 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697083 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697284 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697370 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697582 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697676 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697889 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.697984 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698180 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698265 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698478 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698562 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698787 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.698888 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699084 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699178 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699380 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699471 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699676 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699769 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.699969 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700059 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700284 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700374 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700584 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700670 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.700960 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.701175 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.701262 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.701978 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702071 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702303 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702395 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702620 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702711 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.702922 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703008 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703223 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703308 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703522 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703606 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703835 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.703921 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:36:57.704179 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.704269 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.704507 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.704605 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.704843 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.704931 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705154 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705244 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705477 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705575 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705806 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.705889 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706120 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706204 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706425 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706518 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706734 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.706856 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707053 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707138 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707443 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707661 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707746 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.707966 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708054 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708298 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708411 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708615 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708701 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.708937 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709021 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709247 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709334 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709558 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709643 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709866 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.709950 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710172 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710264 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710484 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710572 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710806 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.710900 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711121 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711208 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711426 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711511 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711767 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.711856 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712104 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712214 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712438 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712526 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712760 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.712854 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713074 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713158 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713382 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713466 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713686 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713787 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.713991 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714076 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714328 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714412 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714637 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714730 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.714943 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715031 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715256 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715343 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715565 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715658 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.715966 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716210 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716300 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716516 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716614 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716821 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.716908 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.717182 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.717807 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718010 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718099 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718349 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718448 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718665 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718759 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.718987 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719085 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719303 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719389 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719613 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719706 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.719924 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720011 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720258 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720369 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720568 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720655 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720875 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.720962 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.721173 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.721269 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.721473 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722175 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722175 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722175 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722376 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722649 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722724 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.722972 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723049 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723273 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723348 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723598 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723672 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.723902 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.725621 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.725719 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.725816 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.725906 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.725987 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726080 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726170 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726251 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726329 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726407 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726550 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726641 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726721 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726800 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726877 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.726955 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727031 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727167 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727258 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727339 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727417 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727495 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727582 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727663 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727741 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727832 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.727919 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728029 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728448 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728665 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728751 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.728973 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729070 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729277 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729364 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729593 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729681 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729898 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.729992 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730204 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730294 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730533 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730618 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730856 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.730951 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731157 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731243 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731466 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731550 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731782 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.731880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732092 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732239 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732413 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732501 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732742 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.732837 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733056 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733144 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733354 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733440 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733651 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733739 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.733952 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734047 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734250 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734391 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734539 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734676 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734818 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.734953 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735114 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735204 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735411 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735499 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735713 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.735797 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736018 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736112 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736344 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736448 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736645 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736736 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.736942 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737257 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737341 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737559 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737653 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737863 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.737958 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738166 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738254 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738503 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738588 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738804 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.738896 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739115 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739200 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739425 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739510 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739730 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.739817 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740036 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740127 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740365 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740461 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740671 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740759 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.740985 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741076 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741293 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741379 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741604 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741692 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741906 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.741999 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742223 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742307 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742526 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742621 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742839 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.742934 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743139 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743226 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743446 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743534 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743751 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.743836 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744068 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744182 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744401 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744497 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744713 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.744809 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745018 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745112 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745327 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745422 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745633 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745720 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.745935 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746034 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746244 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746339 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746547 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746633 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746858 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.746952 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747161 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747247 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747471 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747565 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.747858 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748088 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748238 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748443 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748543 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748747 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.748836 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749045 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749130 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749351 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749488 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749674 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749763 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.749992 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750079 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750293 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750378 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750602 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750688 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.750915 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751002 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751220 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751315 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751524 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751612 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751840 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.751975 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752137 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752270 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752455 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752545 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752758 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.752869 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753069 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753176 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753370 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753467 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753671 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753758 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.753969 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754127 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754348 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754449 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754580 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754668 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754879 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.754976 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755232 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755330 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755478 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755566 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755781 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.755870 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756084 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756209 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756413 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756502 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756723 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.756812 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757022 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757107 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757340 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757425 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757641 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757747 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.757943 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758030 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758243 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758329 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758543 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758635 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758842 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.758929 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759155 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759249 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759460 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759548 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759759 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.759857 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760060 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760183 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760399 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760497 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760705 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.760793 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761010 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761106 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761316 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761402 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761622 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761710 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.761936 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762031 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762244 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762336 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762549 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762637 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762856 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.762944 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763163 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763248 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763470 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763775 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.763863 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.764647 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.764758 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765217 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765320 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765529 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765628 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765834 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.765930 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766135 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766223 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766442 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766530 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766751 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.766836 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767065 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767314 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767404 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767648 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767744 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.767963 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.768052 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.768304 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.768644 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.768780 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769069 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769316 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769423 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769635 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769733 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.769972 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770058 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770290 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770390 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770600 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770687 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.770912 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771001 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771220 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771315 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771524 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771618 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771833 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.771922 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772135 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772346 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772462 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772552 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772792 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.772889 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773101 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773196 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773404 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773490 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773705 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.773792 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774009 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774094 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774313 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774409 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774643 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774758 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.774942 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775054 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775246 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775354 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775591 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775687 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775897 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.775992 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.776285 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.776399 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.776592 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.776682 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.776916 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777001 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777220 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777315 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777524 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777626 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777846 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.777957 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778170 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778273 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778538 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778628 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778863 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.778949 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.779202 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.779309 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.779539 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.780184 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.780508 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.780598 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.780837 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.780944 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781165 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781273 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781485 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781579 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781814 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.781909 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782145 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782300 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782463 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782575 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782772 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.782859 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783077 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783171 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783379 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783474 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783684 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.783769 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784005 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784091 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784339 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784440 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784663 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784809 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.784995 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785090 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785303 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785399 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785605 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785750 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.785927 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786023 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786283 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786370 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786590 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786682 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.786939 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787027 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787274 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787382 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787598 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787702 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.787923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788030 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788296 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788389 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788604 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788689 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.788950 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789044 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789258 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789347 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789596 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789686 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.789930 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790037 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790241 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790331 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790547 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790634 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790891 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.790991 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791203 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791289 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791515 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791602 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791846 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.791941 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.792246 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.792401 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.792608 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.792709 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.792950 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793054 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793253 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793342 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793557 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793643 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.793901 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794016 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794257 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794352 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794562 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794649 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.794866 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795008 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795220 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795357 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795531 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795665 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795834 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.795971 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796133 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796306 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796473 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796629 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796779 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.796932 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797099 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797233 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797404 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797535 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797705 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.797835 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798011 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798163 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798310 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798470 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798669 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798797 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.798972 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799122 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799341 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799440 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799642 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799758 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.799953 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800060 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800289 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800432 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800600 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800739 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.800927 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801077 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801274 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801433 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801578 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801745 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.801893 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802057 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802234 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802398 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802551 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802723 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.802872 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803038 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803173 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803347 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803492 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803658 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803802 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.803959 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804110 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804287 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804450 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804608 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804805 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.804941 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805154 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805273 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805477 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805615 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805786 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.805941 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806101 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806252 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806398 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806538 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806686 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806835 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.806972 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807147 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807280 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807457 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807596 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807766 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.807926 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808172 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808265 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808420 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808517 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808731 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.808821 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809040 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809127 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809349 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809517 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809646 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809732 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.809951 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810037 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810259 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810353 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810559 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810654 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810887 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.810981 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811189 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811285 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811496 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811583 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811794 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.811880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812097 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812261 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812429 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812557 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812738 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.812826 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813041 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813131 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813407 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813492 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813715 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.813801 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814027 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814115 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814338 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814424 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814637 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814725 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.814944 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815047 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815260 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815361 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815655 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815870 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.815959 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816230 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816321 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816537 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816637 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816844 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.816934 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817164 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817250 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817464 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817565 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817765 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.817860 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818063 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818175 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818382 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818481 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818680 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818774 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.818980 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819066 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819282 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819378 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819600 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819695 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819901 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.819988 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.820243 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.820384 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.820656 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.820753 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.820965 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821053 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821267 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821355 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821587 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821696 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821906 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.821995 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822206 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822295 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822514 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822599 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822820 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.822923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823138 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823233 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823456 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823545 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823763 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.823861 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824073 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824196 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824397 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824487 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824714 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.824802 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825027 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825126 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825337 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825435 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825636 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825722 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.825957 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.826056 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.826280 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.826375 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827180 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827290 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827499 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827602 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827820 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.827916 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828123 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828243 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828444 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828537 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828750 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.828861 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829051 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829187 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829352 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829492 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829669 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829795 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.829970 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830105 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830275 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830409 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830581 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830714 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.830884 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831033 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831182 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831338 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831480 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831649 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831799 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.831959 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832099 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832291 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832438 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832595 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832747 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.832904 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833065 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833226 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833379 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833530 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833680 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833851 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.833999 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834163 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834303 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834484 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834603 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834804 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.834899 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835109 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835199 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835431 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835531 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835736 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.835825 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836040 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836127 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836372 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836491 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836677 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.836767 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837019 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837114 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837323 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837419 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837640 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837728 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.837965 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838050 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838270 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838379 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838585 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838705 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.838904 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839003 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839204 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839295 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839503 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839593 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839806 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.839893 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840107 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840235 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840430 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840517 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840729 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.840831 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841032 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841129 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841328 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841414 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841625 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841713 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.841921 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.842016 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.842841 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.842951 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843085 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843184 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843388 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843475 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843691 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843786 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.843993 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844092 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844332 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844434 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844631 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844718 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.844951 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845047 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845260 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845349 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845564 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845653 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845867 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.845963 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846168 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846255 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846481 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846566 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846792 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.846889 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847110 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847197 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847415 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847501 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847723 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.847811 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848034 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848130 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848368 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848462 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848674 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848772 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.848983 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849070 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849294 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849389 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849604 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849693 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.849914 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850116 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850223 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850441 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850540 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850750 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.850838 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851057 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851153 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851363 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851642 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851737 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.851964 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852051 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852298 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852401 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852605 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852690 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.852915 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853032 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853220 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853337 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853529 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853631 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853840 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.853929 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854150 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854248 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854460 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854548 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854768 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.854856 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855076 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855165 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855383 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855478 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855692 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.855787 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856031 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856121 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856363 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856451 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856666 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856839 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.856975 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857062 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857285 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857372 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857592 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857712 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.857948 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.858111 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.858429 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.858566 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.858896 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.858988 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859230 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859318 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859541 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859849 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.859937 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860172 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860262 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860478 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860578 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860794 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.860888 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861106 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861209 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861414 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861517 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861724 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.861819 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862033 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862128 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862343 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862440 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862677 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862859 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.862992 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863170 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863308 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863498 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863620 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863817 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.863934 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.864135 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.864487 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.864588 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.864804 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.864892 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865137 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865224 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865438 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865526 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865742 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.865855 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866049 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866147 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866353 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866452 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866653 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866751 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.866970 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867075 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867275 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867371 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867572 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867668 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867878 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.867987 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.868195 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.868291 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.868515 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.868722 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.868865 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869065 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869157 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869378 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869473 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869698 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.869787 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870017 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870224 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870314 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870569 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870659 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870886 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.870975 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871209 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871306 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871506 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871593 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871817 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.871915 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872121 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872224 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872441 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872528 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872737 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.872834 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873047 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873165 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873372 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873480 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873670 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873759 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.873973 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874060 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874270 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874365 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874577 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874663 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874875 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.874960 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875175 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875274 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875471 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875557 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875774 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.875856 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876070 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876201 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876391 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876478 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876690 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876775 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.876984 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877089 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877290 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877376 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877584 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877671 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877883 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.877977 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878178 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878264 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878478 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878562 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878788 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.878900 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879090 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879187 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879388 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879474 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879688 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879783 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.879992 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880084 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880314 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880405 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880623 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880712 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.880928 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881022 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881245 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881337 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881544 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881645 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881846 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.881932 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882156 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882251 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882464 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882551 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882784 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.882991 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883088 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883320 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883409 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883635 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883722 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.883960 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884055 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884309 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884569 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884656 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884899 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.884993 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885198 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885294 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885516 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885604 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885820 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.885918 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886126 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886218 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886430 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886516 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886732 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.886817 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887040 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887129 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887343 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887431 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887647 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887733 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.887950 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888038 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888273 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888363 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888580 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888680 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.888882 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.889488 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.889714 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890079 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890284 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890379 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890583 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890668 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890889 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.890974 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891198 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891294 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891506 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891596 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891814 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.891904 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892121 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892239 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892453 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892539 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892760 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.892848 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893067 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893156 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893371 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893464 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893675 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893760 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.893985 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894075 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894300 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894385 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894605 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894699 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894907 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.894994 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.895214 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.895568 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.895655 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.895887 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.895975 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.896238 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.896357 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.896546 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.896648 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.896860 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897181 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897282 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897508 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897597 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897818 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.897908 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898135 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898222 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898442 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898529 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898762 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.898858 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899085 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899175 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899396 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899483 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899714 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.899814 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900001 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900090 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900326 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900431 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900628 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900716 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.900933 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901029 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901247 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901344 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901552 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901693 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901852 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.901948 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902150 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902253 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902455 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902543 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902758 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.902845 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903058 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903158 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903356 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903530 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903655 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903743 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.903957 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.904047 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.904274 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.904368 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.904593 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.905207 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.905462 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.905558 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.905759 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.905845 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906061 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906158 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906357 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906446 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906658 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906752 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.906954 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907041 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907253 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907348 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907554 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907642 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907851 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.907945 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908163 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908261 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908473 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908563 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908775 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.908918 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909076 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909174 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909377 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909465 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909753 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.909864 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910005 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910102 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910305 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910392 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910623 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910712 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.910941 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911029 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911246 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911331 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911553 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911660 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911856 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.911965 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912187 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912291 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912496 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912592 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912804 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.912891 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913110 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913195 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913417 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913659 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913824 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.913972 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914109 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914256 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914406 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914549 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914695 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914840 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.914976 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915120 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915256 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915393 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915529 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915672 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915830 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.915972 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916131 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916263 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916474 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916581 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916778 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.916880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917084 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917172 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917391 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917486 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917700 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.917789 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918005 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918104 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918317 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918406 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918623 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918719 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.918926 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919015 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919235 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919334 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919545 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919641 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919860 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.919960 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920209 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920323 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920510 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920597 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920822 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.920908 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921137 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921235 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921474 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921562 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921783 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.921876 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922097 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922196 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922420 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922510 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922733 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.922821 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.923043 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.923141 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.923345 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.923476 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.923586 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112507) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:36:57.923760 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.924022 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.924367 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.924681 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.924985 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:36:57.925225 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=112506) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:36:58.077214 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO dbcounter [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Registered counter for database nova_api Sep 07 14:36:58.079332 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO dbcounter [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Registered counter for database nova_api Sep 07 14:36:58.097985 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_db.sqlalchemy.engines [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.100576 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_db.sqlalchemy.engines [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.104643 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writer thread running {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.106958 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writer thread running {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.161184 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.context [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57904cc0-13ce-49a9-850c-a6dec6864e14(cell1) {{(pid=112507) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 14:36:58.163480 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.context [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57904cc0-13ce-49a9-850c-a6dec6864e14(cell1) {{(pid=112506) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 14:36:58.164952 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:36:58.165420 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:36:58.166975 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:36:58.167308 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:36:58.167679 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:36:58.167769 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:36:58.168115 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:36:58.169365 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:36:58.170077 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:36:58.170173 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_concurrency.lockutils [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112507) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:36:58.170553 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:36:58.172082 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO dbcounter [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Registered counter for database nova_cell0 Sep 07 14:36:58.172567 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:36:58.174636 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO dbcounter [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Registered counter for database nova_cell0 Sep 07 14:36:58.176064 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO dbcounter [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Registered counter for database nova_cell1 Sep 07 14:36:58.178538 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO dbcounter [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Registered counter for database nova_cell1 Sep 07 14:36:58.183451 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_db.sqlalchemy.engines [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.186506 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_db.sqlalchemy.engines [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.188037 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_db.sqlalchemy.engines [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.189622 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_db.sqlalchemy.engines [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.192712 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writer thread running {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.192852 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writer thread running {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.332003 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writer thread running {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.333026 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writer thread running {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.341718 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO dbcounter [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Registered counter for database nova_cell0 Sep 07 14:36:58.342154 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO dbcounter [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Registered counter for database nova_cell0 Sep 07 14:36:58.350658 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_db.sqlalchemy.engines [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112506) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.352270 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG oslo_db.sqlalchemy.engines [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=112507) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:36:58.355493 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writer thread running {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.356966 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writer thread running {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:36:58.801834 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: WARNING keystonemiddleware.auth_token [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:36:58.809053 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: WARNING keystonemiddleware.auth_token [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:36:58.817997 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: WARNING keystonemiddleware.auth_token [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:36:58.825299 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: WARNING keystonemiddleware.auth_token [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:36:59.147731 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: WARNING keystonemiddleware.auth_token [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:36:59.153583 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: WARNING keystonemiddleware.auth_token [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:36:59.159852 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a1b3749c0 pid: 112506 (default app) Sep 07 14:36:59.161924 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:36:59.163096 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] 10.222.0.57 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001698 Sep 07 14:36:59.163502 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 1/1] 10.222.0.57 () {50 vars in 788 bytes} [Wed Sep 7 14:36:59 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:36:59.165671 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: WARNING keystonemiddleware.auth_token [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:36:59.172180 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: WARNING keystonemiddleware.auth_token [None req-c4bae36e-ea65-45eb-9ce9-f0832bd18c41 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:36:59.177495 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564a1b3749c0 pid: 112507 (default app) Sep 07 14:38:23.501253 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:23.504287 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003438 Sep 07 14:38:23.517044 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 2/2] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:23 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:23.523273 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_api:SELECT=3 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:23.524833 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_cell1:SELECT=3 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:23.525963 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_cell0:SELECT=3 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:23.526818 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:24.407295 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-ac83a2ef-a9d3-4eeb-9f31-730cfc36fa1d admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:24.440057 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-ac83a2ef-a9d3-4eeb-9f31-730cfc36fa1d admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.928186 Sep 07 14:38:24.440961 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 1/3] 10.222.0.57 () {60 vars in 1292 bytes} [Wed Sep 7 14:38:23 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 930 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:27.061451 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:27.062439 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0746c3a3-c0e1-4eaf-acfc-b47f02d6f805 None None] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Sep 07 14:38:27.062825 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 3/4] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:27.514289 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-726bb906-01ba-4e8e-8d24-09039ae58ac4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "disk": 1, "id": "c1", "vcpus": 1, "name": "cirros256"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:27.621995 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-726bb906-01ba-4e8e-8d24-09039ae58ac4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.551996 Sep 07 14:38:27.622553 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 2/5] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:27.636371 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_api:SELECT=3 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:27.638434 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_cell0:SELECT=3 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:27.640683 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_cell1:SELECT=3 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:27.641483 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:27.847511 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-8e0a2061-29eb-49f1-af63-34c396e4dce1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:27.997645 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-8e0a2061-29eb-49f1-af63-34c396e4dce1 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366521 Sep 07 14:38:27.998232 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 4/6] 10.222.0.57 () {64 vars in 1336 bytes} [Wed Sep 7 14:38:27 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:30.601699 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-726bb906-01ba-4e8e-8d24-09039ae58ac4 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:30.602791 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-726bb906-01ba-4e8e-8d24-09039ae58ac4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001468 Sep 07 14:38:30.603276 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 3/7] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:31.259085 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-4c61726b-7b45-4e6d-ac2f-e05c69a5f35b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "ram": 512, "name": "ds512M", "id": "d1", "rxtx_factor": 1.0}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:31.367489 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-4c61726b-7b45-4e6d-ac2f-e05c69a5f35b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757537 Sep 07 14:38:31.368463 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 5/8] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:30 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:31.380666 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-de635c01-8bcc-41fa-97df-4c9df1cebd84 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:31.503142 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-de635c01-8bcc-41fa-97df-4c9df1cebd84 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.126152 Sep 07 14:38:31.503749 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 4/9] 10.222.0.57 () {64 vars in 1336 bytes} [Wed Sep 7 14:38:31 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:34.079479 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-4c61726b-7b45-4e6d-ac2f-e05c69a5f35b admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:34.081141 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-4c61726b-7b45-4e6d-ac2f-e05c69a5f35b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002095 Sep 07 14:38:34.081840 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 6/10] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:34.497353 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-ceddfac1-e9ec-44c3-9e55-4dedc3412e89 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds1G", "ram": 1024, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "rxtx_factor": 1.0, "id": "d2", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:34.571999 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-ceddfac1-e9ec-44c3-9e55-4dedc3412e89 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.483916 Sep 07 14:38:34.572637 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 5/11] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:34.584836 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0ed837ce-6ba2-46eb-a154-e82db65aa9ad admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:34.668462 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0ed837ce-6ba2-46eb-a154-e82db65aa9ad admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086691 Sep 07 14:38:34.669058 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 7/12] 10.222.0.57 () {64 vars in 1336 bytes} [Wed Sep 7 14:38:34 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:37.302389 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-ceddfac1-e9ec-44c3-9e55-4dedc3412e89 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:37.303984 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-ceddfac1-e9ec-44c3-9e55-4dedc3412e89 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001999 Sep 07 14:38:37.304424 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 6/13] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:37.730019 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-ecac405e-df84-434c-ae5b-36651fb53010 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds2G", "os-flavor-access:is_public": true, "swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "id": "d3", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 2048, "disk": 10}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:37.790373 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-ecac405e-df84-434c-ae5b-36651fb53010 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.479792 Sep 07 14:38:37.791154 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 8/14] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:37.803463 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-40b3a774-d210-442d-9347-9d2e8d86103e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:37.879328 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-40b3a774-d210-442d-9347-9d2e8d86103e admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079385 Sep 07 14:38:37.891045 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 7/15] 10.222.0.57 () {64 vars in 1336 bytes} [Wed Sep 7 14:38:37 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:40.514350 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-ecac405e-df84-434c-ae5b-36651fb53010 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:40.515962 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-ecac405e-df84-434c-ae5b-36651fb53010 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002283 Sep 07 14:38:40.516494 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 9/16] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:40 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:40.965972 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "id": "d4", "ram": 4096, "rxtx_factor": 1.0, "swap": 0, "name": "ds4G", "vcpus": 4, "disk": 20}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:41.166623 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.643858 Sep 07 14:38:41.167116 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 8/17] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 645 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:41.179240 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-946a0869-adee-4a5f-8b84-75787b716717 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:41.268327 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-946a0869-adee-4a5f-8b84-75787b716717 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.092634 Sep 07 14:38:41.268915 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 10/18] 10.222.0.57 () {64 vars in 1336 bytes} [Wed Sep 7 14:38:41 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:43.897514 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:43.898515 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 07 14:38:43.898918 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 9/19] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:44.376134 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-2994941c-3645-45b4-bf71-a10af1606ed7 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:44.400941 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-2994941c-3645-45b4-bf71-a10af1606ed7 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.495906 Sep 07 14:38:44.401491 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 11/20] 10.222.0.57 () {60 vars in 1292 bytes} [Wed Sep 7 14:38:43 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:38:47.309709 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:47.310762 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-419e4644-3d75-4ba3-b309-662a34808d0b admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 07 14:38:47.311203 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 10/21] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:47.700790 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-d0283f3f-0935-443b-a8b0-7590b54ae01a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "id": "1", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:47.777776 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-d0283f3f-0935-443b-a8b0-7590b54ae01a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.459824 Sep 07 14:38:47.778676 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 12/22] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:47.790717 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-3319c040-efc8-464d-a7e4-7a53608777bb admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:47.890894 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-3319c040-efc8-464d-a7e4-7a53608777bb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.103577 Sep 07 14:38:47.900175 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 11/23] 10.222.0.57 () {64 vars in 1333 bytes} [Wed Sep 7 14:38:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:50.548239 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-d0283f3f-0935-443b-a8b0-7590b54ae01a admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:50.553307 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-d0283f3f-0935-443b-a8b0-7590b54ae01a admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Sep 07 14:38:50.553307 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 13/24] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:50.937699 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-832017c6-bdc5-40af-9e35-0aad7009224c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "swap": 0, "rxtx_factor": 1.0, "vcpus": 1, "ram": 2048, "disk": 20}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:51.730939 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-832017c6-bdc5-40af-9e35-0aad7009224c admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 1.175164 Sep 07 14:38:51.742815 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 12/25] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 1188 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:51.744488 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-cd78a953-9d72-41dc-9e49-b77dba6dc217 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:52.118313 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-cd78a953-9d72-41dc-9e49-b77dba6dc217 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.378220 Sep 07 14:38:52.119233 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 14/26] 10.222.0.57 () {64 vars in 1333 bytes} [Wed Sep 7 14:38:51 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:38:54.715693 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-832017c6-bdc5-40af-9e35-0aad7009224c admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:54.716738 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-832017c6-bdc5-40af-9e35-0aad7009224c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001500 Sep 07 14:38:54.717665 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 13/27] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:54 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:55.179723 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-abb608d6-f599-4bfb-93e5-2fd574ef27e8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "disk": 40, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "swap": 0, "id": "3", "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:55.235153 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-abb608d6-f599-4bfb-93e5-2fd574ef27e8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.511067 Sep 07 14:38:55.235750 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 15/28] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:54 2022] POST /compute/v2.1/flavors => generated 406 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:38:55.250388 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-c332a9d2-53bd-4ff9-9764-96787b72f7bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:55.255496 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:38:55.331201 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-c332a9d2-53bd-4ff9-9764-96787b72f7bf admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.086519 Sep 07 14:38:55.332121 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 14/29] 10.222.0.57 () {64 vars in 1333 bytes} [Wed Sep 7 14:38:55 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:38:57.954394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-abb608d6-f599-4bfb-93e5-2fd574ef27e8 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:38:57.955494 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-abb608d6-f599-4bfb-93e5-2fd574ef27e8 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001617 Sep 07 14:38:57.955978 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 16/30] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:38:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:38:58.415375 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-bc23f9b1-a1c9-42ba-a34d-8a58470904f4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "4", "name": "m1.large", "vcpus": 4, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 8192, "disk": 80, "swap": 0, "rxtx_factor": 1.0}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:58.474348 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-bc23f9b1-a1c9-42ba-a34d-8a58470904f4 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.512395 Sep 07 14:38:58.474903 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 15/31] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:38:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 14:38:58.490596 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-bb3b424a-aa35-4686-931b-e52970869750 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:38:58.560187 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-bb3b424a-aa35-4686-931b-e52970869750 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.076150 Sep 07 14:38:58.562312 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 17/32] 10.222.0.57 () {64 vars in 1333 bytes} [Wed Sep 7 14:38:58 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:39:01.269203 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-bc23f9b1-a1c9-42ba-a34d-8a58470904f4 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:01.270878 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-bc23f9b1-a1c9-42ba-a34d-8a58470904f4 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002203 Sep 07 14:39:01.271494 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 16/33] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:39:01 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:01.765020 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "rxtx_factor": 1.0, "name": "m1.xlarge", "disk": 160, "os-flavor-access:is_public": true, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:01.771738 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:01.995109 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.717298 Sep 07 14:39:01.997878 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 18/34] 10.222.0.57 () {64 vars in 1283 bytes} [Wed Sep 7 14:39:01 2022] POST /compute/v2.1/flavors => generated 408 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:39:02.008323 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-028a5116-c437-4596-957b-fe82fe7d8076 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:02.079660 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-028a5116-c437-4596-957b-fe82fe7d8076 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.075449 Sep 07 14:39:02.080519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 17/35] 10.222.0.57 () {64 vars in 1333 bytes} [Wed Sep 7 14:39:02 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:39:17.371432 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:17.372490 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001522 Sep 07 14:39:17.372896 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 19/36] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:39:17 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:17.383325 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:39:17.762277 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-9ce875d1-e676-4ef1-81af-39104c03d1e8 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:17.780841 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-9ce875d1-e676-4ef1-81af-39104c03d1e8 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.401949 Sep 07 14:39:17.781368 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 18/37] 10.222.0.57 () {60 vars in 1292 bytes} [Wed Sep 7 14:39:17 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:19.099550 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:19.100583 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-84ab496b-3fc4-41e5-8f8e-d7db23be2cc9 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Sep 07 14:39:19.100979 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 20/38] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:19.615203 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-6eec8774-92c7-4d54-b168-a631cd805328 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:19.621474 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.wsgi [None req-6eec8774-92c7-4d54-b168-a631cd805328 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-6eec8774-92c7-4d54-b168-a631cd805328 admin admin] Request method failure captured: Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept: application/json Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept-Encoding: gzip, deflate Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Connection: keep-alive Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Content-Length: 0 Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Host: 10.222.0.57 Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-System-Scope: None Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: User-Agent: python-novaclient Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Auth-Token: gAAAAABjGK0WqQy7nAipASEz7eM6kT7DcQOvDqOdJE5O_fVpw5FCprIBGEH61GE_x1n4LWXBgnWfojaGClYEiisY_ytowRvEK2GPm7kF-GnyElrUemaBgv9K09q6SOIv1E1ynkKRDu_tZSORSFO7s7U5rb8KqeQDZqw4OxAhfYy57Xps_BSp_gU Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Id: None Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Name: None Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Identity-Status: Confirmed Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Is-Admin-Project: True Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Id: default Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Name: Default Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Name: admin Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Role: reader,member,admin Sep 07 14:39:19.624766 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Roles: reader,member,admin Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant: admin Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Name: admin Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User: admin Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Id: default Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Name: Default Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Name: admin Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: method: > Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: exception: Flavor 42 could not be found. Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: action_args: {'id': '42'} Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:19.626435 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:19.627434 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.628876 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-6eec8774-92c7-4d54-b168-a631cd805328 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:19.630243 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-6eec8774-92c7-4d54-b168-a631cd805328 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.387643 Sep 07 14:39:19.630243 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 19/39] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Sep 7 14:39:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 389 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:19.636559 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-dc85aaaa-e7f1-4a1e-8e07-1bedddab1d19 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:19.658864 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-dc85aaaa-e7f1-4a1e-8e07-1bedddab1d19 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026436 Sep 07 14:39:19.661651 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 21/40] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:19.670665 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-407b8caa-fe3d-47cb-ac97-7f3c50d2f324 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:19.693619 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-407b8caa-fe3d-47cb-ac97-7f3c50d2f324 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026592 Sep 07 14:39:19.694165 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 20/41] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:19 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:19.704440 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-6be7c3c8-8e08-43d0-8fe1-adaf0b582584 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:19.710400 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.wsgi [None req-6be7c3c8-8e08-43d0-8fe1-adaf0b582584 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-6be7c3c8-8e08-43d0-8fe1-adaf0b582584 admin admin] Request method failure captured: Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept: application/json Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept-Encoding: gzip, deflate Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Connection: keep-alive Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Content-Length: 0 Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Host: 10.222.0.57 Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-System-Scope: None Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: User-Agent: python-novaclient Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Auth-Token: gAAAAABjGK0WqQy7nAipASEz7eM6kT7DcQOvDqOdJE5O_fVpw5FCprIBGEH61GE_x1n4LWXBgnWfojaGClYEiisY_ytowRvEK2GPm7kF-GnyElrUemaBgv9K09q6SOIv1E1ynkKRDu_tZSORSFO7s7U5rb8KqeQDZqw4OxAhfYy57Xps_BSp_gU Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Id: None Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Name: None Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Identity-Status: Confirmed Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Is-Admin-Project: True Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Id: default Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Name: Default Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Name: admin Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Role: reader,member,admin Sep 07 14:39:19.713652 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Roles: reader,member,admin Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant: admin Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Name: admin Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User: admin Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Id: default Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Name: Default Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Name: admin Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: method: > Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: exception: Flavor 42 could not be found. Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: action_args: {'id': '42'} Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:19.715101 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:19.715880 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:19.722469 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-6be7c3c8-8e08-43d0-8fe1-adaf0b582584 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=112506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:19.723517 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-6be7c3c8-8e08-43d0-8fe1-adaf0b582584 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014206 Sep 07 14:39:19.723517 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 22/42] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Sep 7 14:39:19 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:20.959594 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-407b8caa-fe3d-47cb-ac97-7f3c50d2f324 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:20.960637 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-407b8caa-fe3d-47cb-ac97-7f3c50d2f324 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Sep 07 14:39:20.961061 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 21/43] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:21.500907 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-db512c6a-91be-4dfb-85c5-78acc9ad710a admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:21.506138 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.wsgi [None req-db512c6a-91be-4dfb-85c5-78acc9ad710a admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-db512c6a-91be-4dfb-85c5-78acc9ad710a admin admin] Request method failure captured: Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept: application/json Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept-Encoding: gzip, deflate Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Connection: keep-alive Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Content-Length: 0 Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Host: 10.222.0.57 Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-System-Scope: None Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: User-Agent: python-novaclient Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Auth-Token: gAAAAABjGK0YwJYUDvneUuYqahNMGAvdG4xcs-a2g-KpsHmXDeRxPndx5sfmb3_vUSX9EiMtZBk1UTKr3UvnmXJnXlBSgID7cunMjUcMyeYg6VKk7v_eE48zNc6yPROpCdrTkpeI1Hocb4P8X4He1dgjCHSqf9XGtvO1Hv3jyN0sIfPfFzGhL3w Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Id: None Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Name: None Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Identity-Status: Confirmed Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Is-Admin-Project: True Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Id: default Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Name: Default Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Name: admin Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Role: reader,member,admin Sep 07 14:39:21.507627 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Roles: reader,member,admin Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant: admin Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Name: admin Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User: admin Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Id: default Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Name: Default Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Name: admin Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: method: > Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: exception: Flavor 84 could not be found. Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: action_args: {'id': '84'} Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:21.509162 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:21.510119 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.511394 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-db512c6a-91be-4dfb-85c5-78acc9ad710a admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:21.512760 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-db512c6a-91be-4dfb-85c5-78acc9ad710a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.403779 Sep 07 14:39:21.512760 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 23/44] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Sep 7 14:39:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 405 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:21.518895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-b93cdf65-f233-4799-912a-df99372f3a6b admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:21.533335 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-b93cdf65-f233-4799-912a-df99372f3a6b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018227 Sep 07 14:39:21.533841 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 22/45] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:21.543324 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-db6eff3e-e4a1-43e1-b0cc-59b4360b5a1c admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:21.558893 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-db6eff3e-e4a1-43e1-b0cc-59b4360b5a1c admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019586 Sep 07 14:39:21.559418 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 24/46] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:21.568135 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-543f9bdf-2be4-4799-b12a-550dfa5efd43 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:21.573349 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.wsgi [None req-543f9bdf-2be4-4799-b12a-550dfa5efd43 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-543f9bdf-2be4-4799-b12a-550dfa5efd43 admin admin] Request method failure captured: Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept: application/json Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept-Encoding: gzip, deflate Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Connection: keep-alive Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Content-Length: 0 Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Host: 10.222.0.57 Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-System-Scope: None Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: User-Agent: python-novaclient Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Auth-Token: gAAAAABjGK0YwJYUDvneUuYqahNMGAvdG4xcs-a2g-KpsHmXDeRxPndx5sfmb3_vUSX9EiMtZBk1UTKr3UvnmXJnXlBSgID7cunMjUcMyeYg6VKk7v_eE48zNc6yPROpCdrTkpeI1Hocb4P8X4He1dgjCHSqf9XGtvO1Hv3jyN0sIfPfFzGhL3w Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Id: None Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Name: None Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Identity-Status: Confirmed Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Is-Admin-Project: True Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Id: default Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Name: Default Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Name: admin Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Role: reader,member,admin Sep 07 14:39:21.574831 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Roles: reader,member,admin Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant: admin Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Name: admin Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User: admin Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Id: default Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Name: Default Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Name: admin Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: method: > Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: exception: Flavor 84 could not be found. Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: action_args: {'id': '84'} Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:21.576357 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:21.577449 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:21.578895 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-543f9bdf-2be4-4799-b12a-550dfa5efd43 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=112507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:21.580102 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-543f9bdf-2be4-4799-b12a-550dfa5efd43 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011365 Sep 07 14:39:21.580102 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 23/47] 10.222.0.57 () {60 vars in 1190 bytes} [Wed Sep 7 14:39:21 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 07 14:39:22.781866 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-db6eff3e-e4a1-43e1-b0cc-59b4360b5a1c admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:22.782871 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-db6eff3e-e4a1-43e1-b0cc-59b4360b5a1c admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 07 14:39:22.783265 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 25/48] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:23.296615 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-00705766-7313-4cc3-bb0d-53be1ce78b48 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:23.302269 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.wsgi [None req-00705766-7313-4cc3-bb0d-53be1ce78b48 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-00705766-7313-4cc3-bb0d-53be1ce78b48 admin admin] Request method failure captured: Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept: application/json Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Accept-Encoding: gzip, deflate Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Connection: keep-alive Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Content-Length: 0 Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Host: 10.222.0.57 Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Openstack-System-Scope: None Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: User-Agent: python-novaclient Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Auth-Token: gAAAAABjGK0aZWNW04_G67m6oKP8ybew11k0mXxMjruRkujtgw4c_sQuu4hkVifIGYB6vHqdR4gKll-nWQHVHYqs6pVfei5UIW1OeoX88cNw3e4lSRROQOpDV-dUKRKSwroP5CNCdG645kDSSRmCceBUeOLebV_1rZDZ6rfqGzyaC49nuNkUUkg Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Id: None Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Domain-Name: None Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Identity-Status: Confirmed Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Is-Admin-Project: True Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Id: default Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Domain-Name: Default Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Project-Name: admin Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Role: reader,member,admin Sep 07 14:39:23.303772 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Roles: reader,member,admin Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant: admin Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-Tenant-Name: admin Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User: admin Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Id: default Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Domain-Name: Default Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: X-User-Name: admin Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: method: > Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: exception: Flavor 451 could not be found. Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: action_args: {'id': '451'} Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:23.305445 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:23.306427 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.307519 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-00705766-7313-4cc3-bb0d-53be1ce78b48 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112507) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:23.308619 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-00705766-7313-4cc3-bb0d-53be1ce78b48 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.383727 Sep 07 14:39:23.308619 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 24/49] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:39:22 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 385 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:23.318947 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-48f777f3-719e-4c6c-81cb-a4dfc520f668 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:23.333894 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-48f777f3-719e-4c6c-81cb-a4dfc520f668 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019455 Sep 07 14:39:23.334422 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 26/50] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:39:23.344289 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:23.359446 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018654 Sep 07 14:39:23.359967 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 25/51] 10.222.0.57 () {60 vars in 1210 bytes} [Wed Sep 7 14:39:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:39:23.369078 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-32f4b26c-b806-45b6-a9c9-4c54be775529 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:23.374328 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.wsgi [None req-32f4b26c-b806-45b6-a9c9-4c54be775529 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-32f4b26c-b806-45b6-a9c9-4c54be775529 admin admin] Request method failure captured: Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept: application/json Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Accept-Encoding: gzip, deflate Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Connection: keep-alive Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Content-Length: 0 Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Host: 10.222.0.57 Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-Api-Version: compute 2.92 Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Openstack-System-Scope: None Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: User-Agent: python-novaclient Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Auth-Token: gAAAAABjGK0aZWNW04_G67m6oKP8ybew11k0mXxMjruRkujtgw4c_sQuu4hkVifIGYB6vHqdR4gKll-nWQHVHYqs6pVfei5UIW1OeoX88cNw3e4lSRROQOpDV-dUKRKSwroP5CNCdG645kDSSRmCceBUeOLebV_1rZDZ6rfqGzyaC49nuNkUUkg Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Id: None Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Domain-Name: None Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Identity-Status: Confirmed Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Is-Admin-Project: True Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Openstack-Nova-Api-Version: 2.92 Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Id: default Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Domain-Name: Default Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Project-Name: admin Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Role: reader,member,admin Sep 07 14:39:23.377650 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Roles: reader,member,admin Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_0c46f28c367444249b347e64385a501e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/0c46f28c367444249b347e64385a501e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/0c46f28c367444249b347e64385a501e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant: admin Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Id: 0c46f28c367444249b347e64385a501e Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-Tenant-Name: admin Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User: admin Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Id: default Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Domain-Name: Default Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Id: f0b504610bde4460815c46c6c6298f09 Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: X-User-Name: admin Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: method: > Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: exception: Flavor 451 could not be found. Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: action_args: {'id': '451'} Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:39:23.379568 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:23.380556 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: ERROR nova.api.openstack.wsgi Sep 07 14:39:23.381923 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-32f4b26c-b806-45b6-a9c9-4c54be775529 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=112506) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:39:23.383171 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-32f4b26c-b806-45b6-a9c9-4c54be775529 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011664 Sep 07 14:39:23.383171 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 27/52] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:39:23 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 07 14:39:24.603719 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:24.604765 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Sep 07 14:39:24.605161 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 26/53] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:25.130465 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-835968e8-2375-4788-8ad7-ddd681cce018 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:25.222142 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-835968e8-2375-4788-8ad7-ddd681cce018 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.478985 Sep 07 14:39:25.222674 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 28/54] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Sep 7 14:39:24 2022] POST /compute/v2.1/flavors => generated 404 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:39:26.443844 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:26.444918 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 07 14:39:26.445312 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 27/55] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:26.963796 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0b8e08b5-2f0c-4d1e-bd84-ae988da4bebb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:27.039927 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0b8e08b5-2f0c-4d1e-bd84-ae988da4bebb admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.457674 Sep 07 14:39:27.040508 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 29/56] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Sep 7 14:39:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:39:28.260988 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:28.261997 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 07 14:39:28.262390 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 28/57] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:28.781372 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-94360367-289a-4005-8291-5c7da169449a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:28.861932 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-94360367-289a-4005-8291-5c7da169449a admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.463973 Sep 07 14:39:28.862478 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 30/58] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Sep 7 14:39:28 2022] POST /compute/v2.1/flavors => generated 407 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:39:30.084378 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:30.085391 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001482 Sep 07 14:39:30.085782 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 29/59] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:30.600387 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-4a17d7bc-b160-44de-9e33-209b7e493ae8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:39:30.673324 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-4a17d7bc-b160-44de-9e33-209b7e493ae8 admin admin] 10.222.0.57 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.451353 Sep 07 14:39:30.673866 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 31/60] 10.222.0.57 () {64 vars in 1235 bytes} [Wed Sep 7 14:39:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:39:32.006414 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:32.007429 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001439 Sep 07 14:39:32.007825 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 30/61] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:39:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:39:32.524207 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-1900ef22-470a-43f0-b5f7-4bf2324b9e15 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:39:32.545595 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-1900ef22-470a-43f0-b5f7-4bf2324b9e15 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401261 Sep 07 14:39:32.546081 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 32/62] 10.222.0.57 () {60 vars in 1202 bytes} [Wed Sep 7 14:39:32 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:40:28.952496 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:28.953514 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-be3fc189-5011-4b72-bf56-d416c3215efd admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 07 14:40:28.953907 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 31/63] 10.222.0.57 () {54 vars in 931 bytes} [Wed Sep 7 14:40:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:40:28.965143 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:29.349317 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-260532c7-cd6a-47bb-a577-e5e28e13485b admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:29.370061 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-260532c7-cd6a-47bb-a577-e5e28e13485b admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.410108 Sep 07 14:40:29.376801 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 33/64] 10.222.0.57 () {60 vars in 1292 bytes} [Wed Sep 7 14:40:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:40:29.392463 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG dbcounter [-] [112507] Writing DB stats nova_api:SELECT=14 {{(pid=112507) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:40:29.396301 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-e6206428-10af-4898-81ac-9f04305edb6a admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:29.404561 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-e6206428-10af-4898-81ac-9f04305edb6a admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013819 Sep 07 14:40:29.406620 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 32/65] 10.222.0.57 () {60 vars in 1283 bytes} [Wed Sep 7 14:40:29 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:40:29.417138 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-34743b3b-0801-4ebd-8564-990a613df4b3 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:29.425480 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-34743b3b-0801-4ebd-8564-990a613df4b3 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012373 Sep 07 14:40:29.426035 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 34/66] 10.222.0.57 () {60 vars in 1286 bytes} [Wed Sep 7 14:40:29 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:40:29.441379 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:29.445558 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011494 Sep 07 14:40:29.446079 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 33/67] 10.222.0.57 () {60 vars in 1286 bytes} [Wed Sep 7 14:40:29 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:40:29.457572 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-b1619b52-2258-4567-91a1-7b2657f0a4a2 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:40:29.465629 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-b1619b52-2258-4567-91a1-7b2657f0a4a2 admin admin] 10.222.0.57 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011629 Sep 07 14:40:29.469663 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 35/68] 10.222.0.57 () {60 vars in 1283 bytes} [Wed Sep 7 14:40:29 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:43:35.762361 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:35.763362 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001578 Sep 07 14:43:35.763752 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 34/69] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:43:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:43:35.910457 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_api:SELECT=6 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:36.075463 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:36.078866 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:36.079341 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:36.079763 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:36.080500 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:36.080945 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:36.081358 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:36.115218 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-0fce3ddd-342f-4613-91ed-21331f273e12 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.208627 Sep 07 14:43:36.115761 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 36/70] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:43:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:43:37.203286 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:37.204312 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 07 14:43:37.204697 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 35/71] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:43:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:43:37.392313 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:37.395669 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:37.396131 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:37.396571 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:37.397270 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:37.397705 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:37.398110 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:37.417459 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-c08a694e-296b-4746-a5c8-34e03689e12a admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.074949 Sep 07 14:43:37.417984 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 37/72] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:43:37 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:43:48.988830 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:48.989839 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001437 Sep 07 14:43:48.990229 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 36/73] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:43:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:43:49.130850 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_cell0:SELECT=4 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:49.131581 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_cell1:SELECT=4 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:49.132222 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG dbcounter [-] [112506] Writing DB stats nova_api:SELECT=8 {{(pid=112506) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:43:49.180967 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:49.184443 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:49.184943 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:49.185369 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:49.186148 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:49.186587 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:49.186999 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:49.214232 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-a16062ad-88d9-4695-9752-4ad8a28da550 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.087886 Sep 07 14:43:49.214767 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 38/74] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:43:49 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:43:50.333287 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: DEBUG nova.api.openstack.wsgi [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] Calling method '>' {{(pid=112507) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:50.334287 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: INFO nova.api.openstack.requestlog [None req-0666fde3-9c01-4506-ae00-605e9c6fc363 admin admin] 10.222.0.57 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001408 Sep 07 14:43:50.334669 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: [pid: 112507|app: 0|req: 37/75] 10.222.0.57 () {56 vars in 1074 bytes} [Wed Sep 7 14:43:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:43:50.532571 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG nova.api.openstack.wsgi [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Calling method '>' {{(pid=112506) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:43:50.536128 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:50.536572 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:50.537001 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:50.537717 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:43:50.538166 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:43:50.538898 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: DEBUG oslo_concurrency.lockutils [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=112506) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:43:50.561181 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: INFO nova.api.openstack.requestlog [None req-d2b1bf79-644c-43d0-ae2f-fdf346887ab4 admin admin] 10.222.0.57 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.92 time: 0.085337 Sep 07 14:43:50.561981 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: [pid: 112506|app: 0|req: 39/76] 10.222.0.57 () {60 vars in 1193 bytes} [Wed Sep 7 14:43:50 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:44:49.386201 dv-cinder-801354-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 07 14:44:49.386753 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: Wed Sep 7 14:44:49 2022 - graceful shutdown triggered... Sep 07 14:44:49.387260 dv-cinder-801354-8-iscsi devstack@n-api.service[112506]: Gracefully killing worker 1 (pid: 112506)... Sep 07 14:44:49.388064 dv-cinder-801354-8-iscsi devstack@n-api.service[112507]: Gracefully killing worker 2 (pid: 112507)... Sep 07 14:44:50.387218 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: worker 1 buried after 1 seconds Sep 07 14:44:50.387800 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: worker 2 buried after 1 seconds Sep 07 14:44:50.387800 dv-cinder-801354-8-iscsi devstack@n-api.service[112505]: goodbye to uWSGI. Sep 07 14:44:50.388806 dv-cinder-801354-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 07 14:44:50.389369 dv-cinder-801354-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 07 14:44:50.392481 dv-cinder-801354-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 07 14:44:50.403087 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 07 14:44:50.405756 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Sep 7 14:44:50 2022] *** Sep 07 14:44:50.405910 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 07 14:44:50.406053 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 07 14:44:50.406175 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: nodename: dv-cinder-801354-8-iscsi Sep 07 14:44:50.406287 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: machine: x86_64 Sep 07 14:44:50.406395 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: clock source: unix Sep 07 14:44:50.406501 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: pcre jit disabled Sep 07 14:44:50.406617 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: detected number of CPU cores: 4 Sep 07 14:44:50.406725 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: current working directory: / Sep 07 14:44:50.406831 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: detected binary path: /usr/bin/uwsgi-core Sep 07 14:44:50.406950 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: your processes number limit is 47680 Sep 07 14:44:50.407076 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: your memory page size is 4096 bytes Sep 07 14:44:50.407197 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: detected max file descriptor number: 2048 Sep 07 14:44:50.407309 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: lock engine: pthread robust mutexes Sep 07 14:44:50.407585 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: thunder lock: enabled Sep 07 14:44:50.407894 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 07 14:44:50.408042 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 07 14:44:50.448161 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: Python main interpreter initialized at 0x55665d8159c0 Sep 07 14:44:50.448161 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: python threads support enabled Sep 07 14:44:50.448161 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: your server socket listen backlog is limited to 100 connections Sep 07 14:44:50.448540 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: your mercy for graceful operations on workers is 90 seconds Sep 07 14:44:50.448631 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: mapped 403077 bytes (393 KB) for 2 cores Sep 07 14:44:50.448720 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: *** Operational MODE: preforking *** Sep 07 14:44:50.448969 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: *** uWSGI is running in multiple interpreter mode *** Sep 07 14:44:50.448969 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: spawned uWSGI master process (pid: 127522) Sep 07 14:44:50.449183 dv-cinder-801354-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 07 14:44:50.457778 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: spawned uWSGI worker 1 (pid: 127536, cores: 1) Sep 07 14:44:50.457778 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: spawned uWSGI worker 2 (pid: 127537, cores: 1) Sep 07 14:44:50.457778 dv-cinder-801354-8-iscsi devstack@n-api.service[127522]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 07 14:44:51.117921 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 14:44:51.120923 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 07 14:44:52.279665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:44:52.279665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: from cryptography.utils import int_from_bytes Sep 07 14:44:52.279665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:44:52.279665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: from cryptography.utils import int_from_bytes Sep 07 14:44:52.285091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:44:52.285091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: from cryptography.utils import int_from_bytes Sep 07 14:44:52.285688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 07 14:44:52.285688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: from cryptography.utils import int_from_bytes Sep 07 14:44:54.683166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:44:54.683844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:44:54.684131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:44:54.684382 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:44:54.684638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:44:54.685037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.685367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.685692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.686151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.686330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.686652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.686980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.687311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.687641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.687912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.688253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.688744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-8-iscsi {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.689073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.689387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.689706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.690031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.690341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.690669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.690980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.691493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.692739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.692739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.692739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.692983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.693219 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.693535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.693862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.694177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.694507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.694822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.695232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-8-iscsi {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.695556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.695649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 07 14:44:54.696028 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.696130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 07 14:44:54.696249 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.696566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 07 14:44:54.696721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.696925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 07 14:44:54.697055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.697186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 07 14:44:54.697340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.697578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.697678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.697906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.698995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.699936 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700441 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.700856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-801354-8-iscsi {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701406 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.701979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702307 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.702960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703219 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.703947 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704768 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.704905 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705557 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.705999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706822 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.706945 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-801354-8-iscsi {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.707944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708178 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.708978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.709192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.709285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.709535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.709656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.709858 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.710170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.710496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.710711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.710833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711702 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.711814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.712023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.712647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.712913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.713894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.714828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.715086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.716602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.716719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.716805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.716887 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.716960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717040 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717456 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.717916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.718234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.718351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.718446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.718653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.718966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719327 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.719959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720292 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.720899 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721158 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721252 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.721921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.722115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.722404 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.722496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.722725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723099 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723347 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.723966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.724218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.724333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.724598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.724879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.57 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.724981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725145 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.57 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.725898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726114 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.726833 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.727041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.727141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.727349 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.727452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.727652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.728426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.728620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.728738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.728955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.729985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.730202 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.730301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.730512 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.730636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.730830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.730975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.731138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.731240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.731500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.731621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.731812 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.731914 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.732116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.732299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.732452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.732547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.732762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.732866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.733071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.733208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.733378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.733483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.733687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.733788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.734000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.734101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.734305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.734409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.734612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.734703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.734919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.735019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.735226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.735321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.735546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.735637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.735869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.735975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.736201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.736297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.736517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.736626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.736826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.736930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.737133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.737224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.737454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.737553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.737761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.737854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.738069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.738161 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.738392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.738491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.738701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.738793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.739013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.739141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.739333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.739432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.739640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.739731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.739950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.740044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.740300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.740404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.740605 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.740696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.740917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.741082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.741235 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.741328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.741542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.741632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.741848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.741953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.742153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.742253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.742459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.742566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.742765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.742865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.743071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.743171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.743431 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.743527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.743740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.743830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.744046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.744243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.744394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.744488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.744718 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.744811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.745030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.745124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.745337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.745440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.745643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.745741 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.745961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 07 14:44:54.746053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.746297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.746387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.746615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.746714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.746927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.747963 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.748966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.749924 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.750884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751502 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751718 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.751809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.752800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.753960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.754919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.755979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756308 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.756970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757601 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.757906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758455 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758546 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.758855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.759104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.759415 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.759761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.760074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.760416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.760729 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.760995 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761650 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.761962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.762920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.763868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.764235 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.764374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.764563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.764668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.764872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765182 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.765789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.766019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.766362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.766594 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.766688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.766918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767557 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767650 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.767972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.768976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769160 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769256 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.769892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.770839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771047 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771795 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.771996 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772114 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772659 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772760 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.772972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773601 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.773915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.774008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.774228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.774328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.775859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.776839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777031 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777769 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.777962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778273 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778415 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.778891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779229 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.779948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780583 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.780904 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.781073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.781211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.781383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.781595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.782923 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.783968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.784105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.784269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.784408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.784568 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.784767 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.785391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.785526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.785664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.785804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.785934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.786969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.787947 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.788908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789134 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789557 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.789865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.790088 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.790197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.790951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.791896 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792039 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.792939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793499 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793813 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.793912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.794893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795147 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795644 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.795986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.796122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802657 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.802906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803667 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.803947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.804880 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.805955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806644 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.806998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.807092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.807199 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.807286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.807377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.807462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808727 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.808989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809158 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809430 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809698 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.809919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.810980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811254 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.811927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.812892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.813977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814246 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.814945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.815900 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816715 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.816853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817411 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.817881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818552 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818827 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.818948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.819874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.820964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.821113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.821242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.821356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.822885 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823794 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.823986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.824117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.824325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.824438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.828690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.828794 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.828935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829568 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.829950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830126 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830479 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.830882 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831049 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.831999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832085 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832303 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832631 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.832954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833627 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.833906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834381 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.834918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835112 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835199 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.835948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.836929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.837020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.837691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.837801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.837897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.837991 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838808 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.838914 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839466 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839896 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.839999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.840085 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.840609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.840714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.840802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.840901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841633 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.841887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.842912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843572 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.843988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.844119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.844314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.844452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.844606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.844884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.845816 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.846525 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.846684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.846806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.846929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.847887 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.848020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.848213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.851539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.851683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.851784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.851871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.851963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852127 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.852968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853148 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853697 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.853959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.854941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.855925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856241 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856729 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.856916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.857881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858212 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858525 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858841 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.858948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859148 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.859920 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860767 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.860880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.861794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.862759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.863780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.864052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.868793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.868793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869226 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869733 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869903 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.869987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870236 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.870956 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.871982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872371 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.872926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873783 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.873968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874404 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.874959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875320 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875499 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875592 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.875948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.876979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.877940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.878901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.879963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.880987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881633 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.881940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882572 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.882873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883546 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.883798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.884564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.884684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.884875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885664 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.885940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.886828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887031 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.887805 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888671 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.888766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889320 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.889916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.890997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.891433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.891582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.891730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.891885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892048 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.892803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893241 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.893912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.894007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.894231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.894326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.894538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.895788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896048 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.896838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897154 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897525 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.897798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898432 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.898968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.899079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.899287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.899387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.899687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.900326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.900513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.903994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904292 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.904935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.905939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906475 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.906964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.907962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.910796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.910911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911373 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911555 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911914 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.911999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.912980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.913982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914258 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.914905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.915973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916199 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.916919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.917846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918066 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.918983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919085 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919388 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.919909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920269 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920406 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.920984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.921197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.921316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.921564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.921694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.921902 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922214 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922863 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.922955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923805 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.923942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924555 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.924865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925515 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.925816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926516 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.926916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.927921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.928907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.929861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930810 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.930952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931229 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931544 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.931864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.932062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.932204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934776 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.934952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935366 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935497 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.935976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936504 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936785 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.936973 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937324 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937787 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937880 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.937967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938631 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.938958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.939911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.940891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941736 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.941829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942067 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.942805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.943954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944414 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.944920 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945224 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.945938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.946140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.946233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.947978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.948904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.949977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950291 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.950899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.951021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.951206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.951323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.951465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127536) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:44:54.951564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.951847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.952181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.952509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.952820 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.953151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.953631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.953777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.954095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.954411 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.954719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.955055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.955368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.955678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.955990 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.956327 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.956640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.956951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.957281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.957614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.957919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.958245 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.958563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.958881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.959200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.959511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.959840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.960180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.960486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.960798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.961108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.961419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.961737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.962169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.962983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.963302 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.963622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.963953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.964325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.964638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.964966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.965293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.965645 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.965953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.966299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.966630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.966948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.967329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.967580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 07 14:44:54.967821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=127537) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 07 14:44:55.013249 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO dbcounter [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Registered counter for database nova_api Sep 07 14:44:55.029094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO dbcounter [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Registered counter for database nova_api Sep 07 14:44:55.034427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_db.sqlalchemy.engines [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.041265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writer thread running {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.048836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_db.sqlalchemy.engines [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.055285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writer thread running {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.097283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.context [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57904cc0-13ce-49a9-850c-a6dec6864e14(cell1) {{(pid=127536) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 14:44:55.101367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:44:55.104187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:44:55.104187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:44:55.104187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:44:55.104676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:44:55.106597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:44:55.108648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO dbcounter [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Registered counter for database nova_cell0 Sep 07 14:44:55.111635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.context [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),57904cc0-13ce-49a9-850c-a6dec6864e14(cell1) {{(pid=127537) load_cells /opt/stack/nova/nova/context.py:464}} Sep 07 14:44:55.112726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO dbcounter [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Registered counter for database nova_cell1 Sep 07 14:44:55.115861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:44:55.116386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:44:55.118024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:44:55.118796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:44:55.119247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:44:55.121176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_db.sqlalchemy.engines [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.121466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:44:55.122368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_db.sqlalchemy.engines [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.123547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO dbcounter [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Registered counter for database nova_cell0 Sep 07 14:44:55.127644 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO dbcounter [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Registered counter for database nova_cell1 Sep 07 14:44:55.128770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writer thread running {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.130881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writer thread running {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.137171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_db.sqlalchemy.engines [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.142913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_db.sqlalchemy.engines [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.143641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writer thread running {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.282709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO dbcounter [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Registered counter for database nova_cell0 Sep 07 14:44:55.287016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writer thread running {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.289374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_db.sqlalchemy.engines [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127536) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.294264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writer thread running {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.297839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO dbcounter [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Registered counter for database nova_cell0 Sep 07 14:44:55.307185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_db.sqlalchemy.engines [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=127537) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 07 14:44:55.312078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writer thread running {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 07 14:44:55.620616 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: WARNING keystonemiddleware.auth_token [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:44:55.627916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: WARNING keystonemiddleware.auth_token [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:44:55.642041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: WARNING keystonemiddleware.auth_token [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:44:55.649360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: WARNING keystonemiddleware.auth_token [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:44:55.973272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: WARNING keystonemiddleware.auth_token [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:44:55.979088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: WARNING keystonemiddleware.auth_token [None req-d648330f-442d-4f0f-ba71-a1a9b2c329f4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:44:55.984438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55665d8159c0 pid: 127536 (default app) Sep 07 14:44:55.998001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: WARNING keystonemiddleware.auth_token [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 07 14:44:56.004041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: WARNING keystonemiddleware.auth_token [None req-b460c3b5-7a39-4a4b-b475-207f3186c7ae None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 07 14:44:56.010011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55665d8159c0 pid: 127537 (default app) Sep 07 14:45:44.295725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:44.303077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:44.304079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:44.305519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:45.253649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e3bca37d-51d3-45b6-aa3f-f7194dd9e044 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: .version_select at 0x7fefe0886430>, body: {"keypair": {"name": "tempest-keypair-1237529868", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDA+SlqsgGF1ZbUxv1VNnTIOqQLZgyRWQwinCaZQPPhM9AW3Q/MEFzmCBZkUePFa172QaeDl5IPKUIQUFJEtnBWunx8jKyPwzLr/yhIJzzD7Vi4N/vqX6nWkroqoLnAiWA=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:45.305417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-e3bca37d-51d3-45b6-aa3f-f7194dd9e044 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:45.313740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-e3bca37d-51d3-45b6-aa3f-f7194dd9e044 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:45.493350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e3bca37d-51d3-45b6-aa3f-f7194dd9e044 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.222400 Sep 07 14:45:45.494656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 1/1] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:45:44 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1227 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:45:49.224228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:49.226187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:49.227162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:49.228066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:45:50.219891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f8edc39-7215-4b95-a10e-7444ed98c9d8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: .version_select at 0x7fefe088d700>, body: {"keypair": {"name": "tempest-keypair-404559129", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLORQRMDzTri67YQgPrvIzLtZDA3RgZnuEqj03T7T/ZzhyTREA+Akzb2lPQBxEPhsafAvIYBfKKU0ELYGu4dnrfscZpjEY6voVje0BNZGaB2+A7PUPJaSdCm2CEDqngvdw=="}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:50.313618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-5f8edc39-7215-4b95-a10e-7444ed98c9d8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for project fa5b6b66febc4070a509feee0b0838f6. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:50.325191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-5f8edc39-7215-4b95-a10e-7444ed98c9d8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for user eeab924bf7a646779b48f57f14710e05 and project fa5b6b66febc4070a509feee0b0838f6. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:50.471164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f8edc39-7215-4b95-a10e-7444ed98c9d8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 1.251845 Sep 07 14:45:50.474407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 1/2] 10.222.0.57 () {62 vars in 1200 bytes} [Wed Sep 7 14:45:49 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 1257 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 14:45:51.024380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2077567557", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "networks": [{"uuid": "13bc3e4e-b1ae-4fc1-af55-40984e02ceeb"}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:51.595225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] validate_networks() for [('13bc3e4e-b1ae-4fc1-af55-40984e02ceeb', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:45:52.303388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-282481478", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "163090f4-fd08-48b4-a9ef-0baf5dc14d96"}], "security_groups": [{"name": "tempest-securitygroup--980342054"}], "key_name": "tempest-keypair-1237529868", "user_data": "}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:53.687089 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] validate_networks() for [('163090f4-fd08-48b4-a9ef-0baf5dc14d96', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:45:54.358672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:45:54.362573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:45:54.363296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:45:54.363748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:45:54.364227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:45:54.389170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:54.389855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:54.390295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:54.391027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:54.391744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:54.392207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:54.474505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Getting quotas for project d95dab0bcea84d42b8b92ce81606e2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:54.484290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Getting quotas for user 9f46e69140e347669da323ad08edd7e5 and project d95dab0bcea84d42b8b92ce81606e2ec. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:54.502191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:45:54.505575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:45:54.658584 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a3ff9515-e002-4c3e-a4a3-69d8cf6e6101 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.888144 Sep 07 14:45:54.661223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 2/3] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:45:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 3892 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:45:55.052279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-152074917", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:55.169322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] validate_networks() for [('a8e26959-1568-4534-b648-08fbad1c9109', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:45:56.224507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:45:56.232465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:45:56.232465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:45:56.232465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:45:56.232465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:45:56.258588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:56.259893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:56.260504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:56.269036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:56.269036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:56.269036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:56.310944 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:56.315242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:56.341196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:45:56.344909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:45:56.394817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:45:56.394817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:45:56.394817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:45:56.394817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:45:56.394817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:45:56.407565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:56.408533 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:56.417293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:56.418907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:56.419595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:56.426636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:56.448974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:56.457291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for user 9d8116d648d64a62af52d9db6a607e13 and project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:56.502401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:45:56.509342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:45:56.609038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cdfe571f-2159-45e7-8c4d-10f40120d2c5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 4.313943 Sep 07 14:45:56.610605 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 2/4] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:45:52 2022] POST /compute/v2.1/servers => generated 401 bytes in 4316 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:45:56.623263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fb0cb9ad-ff12-4fc6-b45b-87f124920b18 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:56.634019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fb0cb9ad-ff12-4fc6-b45b-87f124920b18 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:56.750597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ba7e6568-c431-4a8d-a038-1978ac933755 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.067434 Sep 07 14:45:56.750597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 3/5] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:45:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 2069 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:45:56.759278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-446140295", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b485272-8a19-4d1f-a2de-9c7c48b3c305"}], "security_groups": [{"name": "tempest-securitygroup--2007746367"}], "key_name": "tempest-keypair-404559129", "user_data": "}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:57.017386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fb0cb9ad-ff12-4fc6-b45b-87f124920b18 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:57.044771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fb0cb9ad-ff12-4fc6-b45b-87f124920b18 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1215 microversion: 2.1 time: 0.431815 Sep 07 14:45:57.050039 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 3/6] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:56 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1215 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:45:57.061686 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-87490515-d1f5-44a8-bf1d-c9778a73dcb3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:57.062490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-87490515-d1f5-44a8-bf1d-c9778a73dcb3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:57.160918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] validate_networks() for [('6b485272-8a19-4d1f-a2de-9c7c48b3c305', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:45:57.469370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-87490515-d1f5-44a8-bf1d-c9778a73dcb3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:57.478416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-87490515-d1f5-44a8-bf1d-c9778a73dcb3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1241 microversion: 2.1 time: 0.427069 Sep 07 14:45:57.484172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 4/7] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:57 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1241 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:45:57.511439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8441ce4b-5c0b-49fe-91fb-11edf6559f34 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:57.512114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8441ce4b-5c0b-49fe-91fb-11edf6559f34 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:57.709716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8441ce4b-5c0b-49fe-91fb-11edf6559f34 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:57.732259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8441ce4b-5c0b-49fe-91fb-11edf6559f34 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1221 microversion: 2.1 time: 0.230260 Sep 07 14:45:57.734888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 5/8] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:57 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1221 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:45:57.877938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-526122948", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:45:58.044861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] validate_networks() for [('a8e26959-1568-4534-b648-08fbad1c9109', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:45:58.676519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:45:58.677447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:45:58.678224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:45:58.680282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:45:58.686399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:45:58.694843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:58.695562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:58.696164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:58.697054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:58.697517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:58.698006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:58.718861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for project fa5b6b66febc4070a509feee0b0838f6. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:58.723669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for user eeab924bf7a646779b48f57f14710e05 and project fa5b6b66febc4070a509feee0b0838f6. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:58.746085 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:45:58.749413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:45:58.956970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7c578b7f-6bff-4ade-a8e7-e521bffa15f6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.221142 Sep 07 14:45:58.961863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 4/9] 10.222.0.57 () {62 vars in 1188 bytes} [Wed Sep 7 14:45:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 2230 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 14:45:58.983158 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:58.984860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:59.060646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.062564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.063225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.067219 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.077325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.079237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.353668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:45:59.354780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:45:59.355465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:45:59.357396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:45:59.362407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:45:59.388483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.388483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.388483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.392816 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.393594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.394248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.428183 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.440537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:45:59.445156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for user 9d8116d648d64a62af52d9db6a607e13 and project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:45:59.454057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a79668ba-a172-4417-bb3b-6c97acd6335d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1211 microversion: 2.1 time: 0.489699 Sep 07 14:45:59.470096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 5/10] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:58 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1211 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:45:59.470720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:45:59.470720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:45:59.470915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:59.470915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:59.476489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.478947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.483815 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.484606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:45:59.485087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:45:59.485542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:45:59.652017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.665400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4d5960fd-2bfc-4975-96d7-468ea3632930 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.791461 Sep 07 14:45:59.669073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 6/11] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:45:57 2022] POST /compute/v2.1/servers => generated 383 bytes in 1793 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:45:59.674299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:59.675289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:59.692809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-62b3b3e3-24df-4054-ab92-1d2932918a82 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1245 microversion: 2.1 time: 0.231216 Sep 07 14:45:59.713267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 6/12] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:59 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1245 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:45:59.731603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0a8c0e7e-eb4d-4b7c-96aa-667d18015746 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:45:59.741475 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0a8c0e7e-eb4d-4b7c-96aa-667d18015746 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:45:59.786635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.822619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.822619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.825798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-21a773a3-4f9c-4fb6-8ba5-af3405fa9ae7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1280 microversion: 2.20 time: 0.158451 Sep 07 14:45:59.826550 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 7/13] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:45:59 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1280 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:45:59.874045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0a8c0e7e-eb4d-4b7c-96aa-667d18015746 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:45:59.897239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0a8c0e7e-eb4d-4b7c-96aa-667d18015746 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1221 microversion: 2.1 time: 0.175695 Sep 07 14:45:59.897239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 7/14] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:45:59 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1221 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:00.482201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:00.489497 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:00.496577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.498135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.498742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.499595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.500802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.501334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.719629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:00.720568 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:00.734976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.754265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:00.765399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.030s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.770585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.771935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.774829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.778297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.795555 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-da619185-4de6-4dc5-b6fa-5f8fe6fe51e9 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1275 microversion: 2.1 time: 0.319544 Sep 07 14:46:00.799694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 8/15] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:00 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1275 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:00.862449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:00.863269 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:00.873877 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.874383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.874826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.876643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:00.877370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:00.877959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:00.918991 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:00.933392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c88e10be-f235-4536-8f40-87119117d8e6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1237 microversion: 2.1 time: 0.218536 Sep 07 14:46:00.934666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 8/16] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:00 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1237 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:00.962405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d5448342-3941-442a-b22d-df5da6653311 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:00.963499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d5448342-3941-442a-b22d-df5da6653311 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:01.101722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:01.114552 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:01.116653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:01.121976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6d35f779-bcf7-4ab8-a41d-7e126dcb7953 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1284 microversion: 2.20 time: 0.263380 Sep 07 14:46:01.124530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 9/17] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:00 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1284 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:01.198749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d5448342-3941-442a-b22d-df5da6653311 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:01.209017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d5448342-3941-442a-b22d-df5da6653311 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1221 microversion: 2.1 time: 0.273673 Sep 07 14:46:01.210538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 9/18] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:00 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1221 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:01.822341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:01.823092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:01.838786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:01.842040 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:01.843455 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:01.846275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:01.848439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:01.851781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:01.958182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:01.959007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:01.979310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:01.980703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:01.984634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:01.988601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:01.992072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:01.995561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:02.269279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.279768 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.280060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ab5405f1-4ed7-458b-a404-41b5cb974c24 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1273 microversion: 2.1 time: 0.463264 Sep 07 14:46:02.281417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 10/19] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:01 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1273 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:02.288312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-70d4c907-2c1b-4541-9a78-a1fb6b41487f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1293 microversion: 2.1 time: 0.334494 Sep 07 14:46:02.288888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 10/20] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:01 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1293 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:02.297278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:02.299691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:02.308672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:02.309736 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:02.321833 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:02.323741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:02.326664 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:02.331654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:02.332076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:02.332076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:02.332076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:02.333484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:02.333866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:02.334492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:02.335674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:02.336483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:02.474701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.490711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1344f3aa-ff1b-41bb-864f-eee9c073bb67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1217 microversion: 2.1 time: 0.193866 Sep 07 14:46:02.494637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 11/21] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:02 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1217 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:02.584519 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.597438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.597438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:02.597438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0185c554-6430-418f-b3f0-500152f7765f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1276 microversion: 2.20 time: 0.313951 Sep 07 14:46:02.614730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 11/22] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:02 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1276 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:03.304462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:03.305096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:03.314683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:03.315522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:03.327738 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.328544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.329157 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:03.330052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.330213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.330850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.332298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:03.336431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.336650 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.337360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:03.351585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.351585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:03.572948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:03.587133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c5fe57d3-5c12-4a9e-b87e-0b75043f1459 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1311 microversion: 2.1 time: 0.277681 Sep 07 14:46:03.588778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 12/23] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:03 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1311 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:03.599761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:03.601544 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:03.619030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.619674 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.620464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:03.621279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:03.627233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:03.628554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:04.334362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.361523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6ba2cd8b-f026-4cca-9b76-f0bdbf9c3a20 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1217 microversion: 2.1 time: 0.771030 Sep 07 14:46:04.363108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 13/24] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:03 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1217 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:04.376380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:04.378312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:04.399519 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:04.400318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:04.400908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:04.401769 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:04.402461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:04.403029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:04.455622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.465418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7fab5f60-2767-48cc-b6a7-e828ae6a05ad tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 1.166092 Sep 07 14:46:04.471092 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 12/25] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:03 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 1172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:04.551787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.566563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.572280 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.574384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2568c07a-a32e-454e-b2d4-b2ee6d2a5664 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1340 microversion: 2.20 time: 0.209365 Sep 07 14:46:04.576895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 14/26] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:04 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1340 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:04.615436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:04.617627 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:04.633283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:04.635445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:04.638332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:04.639569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:04.641792 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:04.642248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:04.851021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:04.873055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-87ffa8a1-9de5-44ad-9c4f-19774a829972 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1299 microversion: 2.1 time: 0.251799 Sep 07 14:46:04.874027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 13/27] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:04 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1299 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:05.395404 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:05.396125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:05.407729 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.408260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.414250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.416267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.416762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.417212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.499344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:05.499344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:05.508367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.509880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.516022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.517461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.521598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.522330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.743309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:05.752551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dbce1c70-f663-42f9-b311-7881de6e88de tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1281 microversion: 2.1 time: 0.361509 Sep 07 14:46:05.757697 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 15/28] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:05 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1281 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:05.769113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:05.773410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:05.789060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.795390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.795996 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.796973 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:05.798700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:05.799198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:05.999044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.019303 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.025290 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.044306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7c0f3e18-f554-499d-b748-830c3ba01602 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1338 microversion: 2.20 time: 0.268095 Sep 07 14:46:06.044306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 16/29] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:05 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1338 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:06.060640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:06.061598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:06.074753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:06.076507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:06.078158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:06.079411 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:06.082266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:06.083825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:06.305811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.320790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-901a05ac-53e9-48b1-b7b8-6d1e6303bf41 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.828358 Sep 07 14:46:06.327631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.333369 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 14/30] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:05 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:06.347137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fa97d3cf-564f-4b84-8795-5979b353582d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1299 microversion: 2.1 time: 0.297924 Sep 07 14:46:06.375631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 17/31] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:06 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1299 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:06.787928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:06.789443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:06.808303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:06.808912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:06.809619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:06.810600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:06.811272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:06.811912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:06.923852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:06.937573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bfadd24b-a454-4394-b191-99cabf6aa905 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1279 microversion: 2.1 time: 0.151493 Sep 07 14:46:06.952353 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 15/32] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:06 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1279 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:07.066574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:07.069635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:07.081041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.081797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.082428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:07.083344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.087195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.087879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:07.345199 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:07.345864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:07.356839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.360600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.362865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:07.362865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.365744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.367822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:07.370879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:07.386955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:07.390584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:07.396435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2275864a-9958-40be-8202-dde5e6773f09 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1338 microversion: 2.20 time: 0.332945 Sep 07 14:46:07.399845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 18/33] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:07 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1338 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:07.417495 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:07.420899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:07.442988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.443657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.444382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:07.445481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:07.446076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:07.447037 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:08.227951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:08.241618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cc351715-f05e-48c4-b69b-f1e84298b9e7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.838631 Sep 07 14:46:08.245717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 19/34] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:07 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 845 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:08.256835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:08.260369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:08.279874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:08.280617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:08.281202 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:08.282112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:08.284807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:08.288893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:08.364222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:08.378799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7cb7dc47-86e5-4da7-a108-cc57b898ddc0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 1.037263 Sep 07 14:46:08.379428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 16/35] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:07 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 1039 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:08.435358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:08.435973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:08.455948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:08.456663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:08.457101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:08.457806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:08.458258 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:08.458670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:08.507800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:08.523977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0e0ec400-25af-4867-b6eb-221422ef9b45 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1279 microversion: 2.1 time: 0.277050 Sep 07 14:46:08.526134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 20/36] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:08 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1279 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:08.710932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:09.270125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:09.270786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:09.288533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.288533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.288533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:09.288533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.288810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.289170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:09.385250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:09.406083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:09.413052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=4 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:09.413883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:09.417121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d47393c9-2453-4644-a70e-492e8b4dc42c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.985669 Sep 07 14:46:09.418713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 17/37] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:08 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 987 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:09.593414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:09.604224 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2b289715-16c7-4a0d-a0a4-99c5179a5ea0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.338439 Sep 07 14:46:09.605445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 21/38] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:09 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:09.620417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:09.621280 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:09.630449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.631176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.642775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:09.642775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.642775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.642775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:09.791468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=24 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:09.875741 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5eb777ae-e8d8-4d7c-85af-904ef78d3a08", "tag": "b42c4fad-eada-45fb-8006-58c5896075f3"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:09.906663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.920850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.920850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:09.982855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Creating event network-changed:b42c4fad-eada-45fb-8006-58c5896075f3 for instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 on hv-cinder-80135 Sep 07 14:46:09.983393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 14:46:09.983781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b4a58dad-408a-4b95-9edf-b940270088db req-9cb29c74-0d9d-42b7-a398-439bdd5f1167 service nova] Acquired lock "compute-rpcapi-router" {{(pid=127536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 14:46:09.984870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:09.985322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:09.985746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.001190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.001718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.002156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.014091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.compute.rpcapi [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 14:46:10.015009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] Releasing lock "compute-rpcapi-router" {{(pid=127536) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 14:46:10.044329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-954c6493-20e0-47d3-87e0-3ff71f473c51 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.625288 Sep 07 14:46:10.045352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 18/39] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 627 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:10.055081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:10.059186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:10.068218 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.073380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.073380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.073380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.073380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.073801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.080464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.095375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4f024404-f1ef-42da-89cf-cba522ebfd6a tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.488664 Sep 07 14:46:10.096362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 22/40] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:09 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:10.316329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.327813 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-94099d97-5889-4a5c-8948-fd441f1839e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.281253 Sep 07 14:46:10.328756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 19/41] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:10 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:10.443941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:10.443941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:10.452391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.453047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.453752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.454761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.455353 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.455945 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.520053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74bb9f3f-4ce1-4649-997e-77d7079c6ee9", "tag": "c4cce5f5-f4ed-4887-920c-bc901c548597"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:10.533545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.545592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.548180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.588968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Creating event network-changed:c4cce5f5-f4ed-4887-920c-bc901c548597 for instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 on hv-cinder-80135 Sep 07 14:46:10.589665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Acquiring lock "compute-rpcapi-router" {{(pid=127537) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 07 14:46:10.590087 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bdf83d1-d7b3-4c0a-8bdd-fc97f5667662 req-f345283f-f4bc-45cf-925e-124976acf08a service nova] Acquired lock "compute-rpcapi-router" {{(pid=127537) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 07 14:46:10.592578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.592578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.592578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.594296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.596563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.597264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.609266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.compute.rpcapi [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 07 14:46:10.610328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] Releasing lock "compute-rpcapi-router" {{(pid=127537) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 07 14:46:10.634020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6dd9e03e-611f-4f27-b7a0-72b1e437dbc0 None None] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.449679 Sep 07 14:46:10.635041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 23/42] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:46:10.644380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:10.645276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:10.655839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.656549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.657132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.658532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:10.659144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:10.659718 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:10.665823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:10.701796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.710641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.712062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.713206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cb55219c-6540-4de5-bcad-87e73151edf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.274198 Sep 07 14:46:10.713764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 20/43] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:10 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:10.851369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:10.860137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c005c412-dc74-453b-8f37-14a60f1f9985 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.222142 Sep 07 14:46:10.861053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 24/44] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:10 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:11.119455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:11.120406 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:11.124172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:11.129620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.130833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.141579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.141579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.141579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.141579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.204290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=26 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:11.355433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:11.356531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:11.358691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:11.364452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.365063 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.365609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.366490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.367287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.367871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5e73439f-28f9-4e57-ad3a-5061428b5c9e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.252317 Sep 07 14:46:11.368086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.368643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 21/45] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:11 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:11.559846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:11.576594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-44d3c5d3-5bd1-44b0-92f5-465625391a32 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.226606 Sep 07 14:46:11.577243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 25/46] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:11 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:11.742475 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:11.743143 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:11.764959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.771187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.771187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.771187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.771187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.771476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.886941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:11.889420 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:11.895076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:11.896669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.897186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.897623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:11.898413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:11.898769 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:11.899193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.050115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.054205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:12.064972 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.066429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.067575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9ef0c2d4-4298-4857-aca3-7982a91d6859 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.332538 Sep 07 14:46:12.068176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 22/47] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:11 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:12.089803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5f6be2-5405-4fec-9c2c-584b8e270d1a", "tag": "24b0bebe-bbc1-43a9-9520-065202c5da6c"}, {"name": "network-changed", "server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:12.108732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:12.109342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:12.110011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.127911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.137954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Creating event network-changed:24b0bebe-bbc1-43a9-9520-065202c5da6c for instance be5f6be2-5405-4fec-9c2c-584b8e270d1a on hv-cinder-80135 Sep 07 14:46:12.138146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c97212a6-9917-44e6-8831-6c17fd4afa98 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.258959 Sep 07 14:46:12.138455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] Creating event network-changed:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:46:12.146968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-8da0962e-9359-445b-a061-27baf8edfe47 req-b56eecb3-6120-4409-80eb-b8ee711f3bb0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.060746 Sep 07 14:46:12.150955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 23/49] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:12.155836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 26/49] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:11 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:12.393076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:12.394271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:12.400639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:12.401318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:12.401747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.402433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:12.402882 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:12.403298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.599919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:12.601233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:12.602483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.607652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:12.608185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:12.608689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.609406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:12.610200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:12.610825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:12.615006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d0e44751-13c9-4793-9812-a9ac7c7ddd3e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.227493 Sep 07 14:46:12.617018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 24/50] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:12 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:12.838787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:12.855569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-904d4ab2-5e9f-4e7a-8427-b937503cadaa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.259206 Sep 07 14:46:12.871620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 27/51] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:12 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:13.099758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:13.103625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:13.123681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.124195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.124652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.127329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.127895 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.128371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.163822 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:13.164758 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:13.174972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.175675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.176302 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.177262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.177986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.178812 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.477132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:13.488368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:13.495438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:13.496714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:13.497030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-63488d53-9e77-4b32-8623-f93dfed38b1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.404602 Sep 07 14:46:13.500203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 25/52] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:13 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:13.521333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a6b74df8-55d2-49d9-a001-93d3d658c17e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.361988 Sep 07 14:46:13.528192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 28/53] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:13 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:13.641683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:13.642598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:13.651243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.651923 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.652601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.653492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.654109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.654705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.859334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:13.867883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0ec2790c-eac8-4156-b06d-3672c08896ee tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.230891 Sep 07 14:46:13.868581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 26/54] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:13 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:13.878937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:13.879586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:13.886098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.886594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.887007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:13.887690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:13.888161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:13.888592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.034932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:14.042654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7c983a0b-4f75-47fb-a227-03b7807a4134 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.167565 Sep 07 14:46:14.060192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 29/55] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:13 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:14.526712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:14.527441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:14.533605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.534539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.534539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.535168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.535613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.536037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.551299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:14.552738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:14.559468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.560235 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.560679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.561518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.562181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.562709 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.752703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:14.760911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:14.764477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:14.765960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:14.767483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2d4de6bc-2f49-44c6-babb-3e7d86db7438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.245005 Sep 07 14:46:14.768656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 27/56] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:14 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:14.769910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-01f2ab56-f7b6-4fc8-99b6-10e927e42688 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.222889 Sep 07 14:46:14.772738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 30/57] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:14 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:14.890722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:14.891338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:14.898020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.898506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.898943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:14.899633 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:14.900091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:14.900539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.044447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:15.052428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-09b13d73-5ed1-4880-b59f-733b719ada92 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.165507 Sep 07 14:46:15.052999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 28/58] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:14 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:15.072813 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:15.074019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:15.080299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.080803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.081248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.081951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.085886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.085886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.308871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:15.317535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-74c2ec65-8d8c-4ca3-a034-7e8c194282db tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.252462 Sep 07 14:46:15.319066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 31/59] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:15 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:15.793701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:15.794350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:15.800861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.801352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.801788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.802492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.802979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.803701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:15.803885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.804673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:15.820015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.820546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.820989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:15.821696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:15.822149 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:15.825377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:16.170952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.185351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.191574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f20238fc-c0e2-4a95-bda6-9a5c1694e086 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.392204 Sep 07 14:46:16.192217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 32/60] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:15 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:16.200567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:16.201375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:16.212325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.214852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.216428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5353cccd-d4f4-4464-a0f4-2a8bdd2e0c67 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.426857 Sep 07 14:46:16.217573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 29/61] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:15 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:16.220253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:16.221018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:16.221667 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:16.222574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:16.223266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:16.223936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:16.344091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:16.344745 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:16.358721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:16.359313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:16.360022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:16.361117 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:16.361778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:16.362436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:16.598075 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.611403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b3386684-eca4-4c69-8558-0f8887548a91 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.417983 Sep 07 14:46:16.612347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 33/62] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:16 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:16.946607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:16.956187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fe222ba7-49c0-42aa-a2f0-221311dbfd3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.619193 Sep 07 14:46:16.968184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 30/63] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:16 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:17.214938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:17.217325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:17.226566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.227178 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.227621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.228416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.228932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.229652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.245893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:17.246675 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:17.256061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.260369 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.261002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.261899 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.262497 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.263448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.890487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:17.912597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:17.912835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0dc90edd-d103-4696-91c1-3df9fa7f821a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.688047 Sep 07 14:46:17.912933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:17.912933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:17.912933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-130454fc-f21a-4c6d-8f74-9ae417abe3b9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.670026 Sep 07 14:46:17.913715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 34/64] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:17 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 703 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:17.914055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 31/65] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:17 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:17.920965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:17.921597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:17.928664 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.929338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.929937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.930796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.931400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.932012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.982193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:17.982824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:17.988947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.989423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.989850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:17.991020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:17.991523 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:17.991977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:18.264623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:18.270548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f260c5e-c5aa-4c7d-bc45-e38e4324c07f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.353337 Sep 07 14:46:18.271126 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 35/66] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:17 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:18.306139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:18.316358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c9573f4-8027-479b-89e5-8701b44484f8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.339164 Sep 07 14:46:18.317227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 32/67] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:17 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:18.598447 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "301a5877-a659-4739-8532-4e44fe18c220", "tag": "2c86e722-7302-4ac6-a690-d68f41da2e37"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:18.630108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:18.630108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:18.630108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:18.652179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] Creating event network-changed:2c86e722-7302-4ac6-a690-d68f41da2e37 for instance 301a5877-a659-4739-8532-4e44fe18c220 on hv-cinder-80135 Sep 07 14:46:18.655114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-b37f3557-8aa3-4398-aea2-411e73181923 req-d6fd8de9-949e-431d-aa20-0d2565f673e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060647 Sep 07 14:46:18.656078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 36/68] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:18.924075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:18.925041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:18.932930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:18.933598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:18.934469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:18.935378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:18.935978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:18.936716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:18.950817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:18.955208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:18.961182 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:18.962015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:18.962806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:18.964438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:18.965044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:18.965625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:19.206035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.210601 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.214513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fecbd44e-d892-4113-bd3c-b3d02562b778 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.294356 Sep 07 14:46:19.215088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 33/69] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:18 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:19.218865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.220328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.222321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-723e33cc-115e-49c1-ad56-4f9f548c5232 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.281645 Sep 07 14:46:19.236272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 37/70] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:18 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:19.296549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:19.297850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:19.306353 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:19.307103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:19.307997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:19.309378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:19.310436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:19.311199 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:19.340579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:19.344639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:19.347775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:19.348289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:19.348722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:19.349446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:19.350523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:19.354002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:19.530003 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.539791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-800cca61-1abf-476c-a87f-6ad15cffa005 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.249079 Sep 07 14:46:19.545235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 34/71] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:19 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:19.566506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:19.578791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-58037e24-3e55-4ac4-91d6-deec01ba5253 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.242870 Sep 07 14:46:19.579372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 38/72] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:19 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:20.238467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:20.239341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:20.242383 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:20.247477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.248252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.248916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.250230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.250906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.251692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.257538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:20.258363 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:20.267073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.267968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.269204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.269757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.270478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.271000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.608854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:20.886990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:20.914618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:20.918823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5ee28603-dae3-4ad0-9434-6609e58947e1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.683346 Sep 07 14:46:20.920975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 35/73] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:20 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 687 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:20.925474 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:20.928482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:20.930328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:20.936890 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:20.938260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8c008720-2dac-4e8b-a4e6-1e5a907284ec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.687231 Sep 07 14:46:20.938839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 39/74] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:20 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 688 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:20.948385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.948385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.948385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.948385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.948717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.948717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.958530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:20.963302 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:20.992058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:20.994217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:20.994217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:20.994217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:21.001165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:21.003426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:21.392522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:21.406525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d165ec12-fb8f-4e6f-b3eb-58ad7c321133 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.484257 Sep 07 14:46:21.420188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 36/75] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:20 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:21.428773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:21.438534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-195789d0-c14e-4928-9910-a0e215b7dbf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.498630 Sep 07 14:46:21.439482 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 40/76] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:20 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:21.946804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:21.947422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:21.961009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:21.961510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:21.961955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:21.962680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:21.963141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:21.967158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:21.968654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:21.969633 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:21.977966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:21.979905 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:21.980526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:21.981458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:21.982077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:21.982760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:22.004305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:22.352765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.360444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.374463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-76ab85ba-3954-4d52-8314-af57326ac9e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.425533 Sep 07 14:46:22.374638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.377387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.378815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2a65f9ba-4bb4-4905-b586-5ab31e6a9d61 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.415895 Sep 07 14:46:22.394095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 41/77] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:21 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:22.394411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 37/78] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:21 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:22.439830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:22.440965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:22.450159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:22.451074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:22.451804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:22.453163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:22.453876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:22.454741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:22.463498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:22.465634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:22.481640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:22.482149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:22.482593 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:22.484405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:22.484929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:22.487432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:22.722004 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.730288 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fb09d0c7-e186-4e2e-8a04-9248074d5cab tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.297014 Sep 07 14:46:22.730849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 42/79] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:22 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:22.737486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:22.746477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-45b792ed-4052-44d2-87f3-7e51b2837b98 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.287529 Sep 07 14:46:22.747154 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 38/80] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:22 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:23.423808 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:23.425452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:23.426613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:23.430119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:23.443285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.444403 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.444832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.445550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.445997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.448616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.448616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.455354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.456091 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.456698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.457181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.458592 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.687049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:23.695223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:23.696844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1f8c11b2-7664-4036-ac1b-5b53556be08d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.288914 Sep 07 14:46:23.697605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 39/81] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:23 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:23.705111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:23.715961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:23.715961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d8772990-e559-492c-b401-b3a145610dbe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.302199 Sep 07 14:46:23.715961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 43/82] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:23 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:23.758254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:23.759239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:23.766220 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.767163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.767731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.768607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.769312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.770300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.789787 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bb9f3f-4ce1-4649-997e-77d7079c6ee9", "name": "network-vif-plugged", "status": "completed", "tag": "c4cce5f5-f4ed-4887-920c-bc901c548597"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:23.799769 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.800281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.800814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.818075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:23.821424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] Creating event network-vif-plugged:c4cce5f5-f4ed-4887-920c-bc901c548597 for instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 on hv-cinder-80135 Sep 07 14:46:23.826867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-f1fe7b0c-fdbc-41df-a202-21268bf67b70 req-796544cc-5196-4ebc-b3f1-3940398975b1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.100361 Sep 07 14:46:23.827465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 40/83] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:23.834861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:23.834861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:23.841905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.842389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.842998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.843693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:23.844330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:23.844754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:23.961225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:23.970351 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-de6e74cf-bfe6-44af-bc5a-4f76fd2af77e tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.216777 Sep 07 14:46:23.972036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 44/84] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:23 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:24.041876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:24.053708 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8aa76cad-c73e-48f3-b8d5-7735ab9eb56b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.223555 Sep 07 14:46:24.054295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 41/85] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:23 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:24.723587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:24.724342 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:24.737777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:24.737777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:24.737777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:24.737777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:24.738221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:24.746143 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:24.746779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:24.753531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:24.757651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:24.758625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:24.759390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:24.760400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:24.762574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:24.763030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.001128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.009341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7ce8a4d0-43e8-4f06-87e4-81e962aa06ea tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.292220 Sep 07 14:46:25.009676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 45/86] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:24 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:25.014390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:25.014992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:25.019957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.021226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:25.021757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:25.022189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.022874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:25.023321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:25.023740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.033342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.034761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.035862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-28e43d65-4f7f-4b05-ab0d-8c22060a9aea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.296143 Sep 07 14:46:25.040573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 42/87] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:24 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:25.078625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:25.079322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:25.090085 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:25.090570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:25.090998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.091718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:25.092192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:25.092605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.221971 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.237078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4dddc1b4-1668-4aa3-a86a-9af4710df23c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.226185 Sep 07 14:46:25.237672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 46/88] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:25 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:25.289218 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:25.297416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-75aa1c71-f8a2-4a5b-b930-6761af6659f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.224134 Sep 07 14:46:25.298192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 43/89] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:25 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:25.843914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb777ae-e8d8-4d7c-85af-904ef78d3a08", "name": "network-vif-plugged", "status": "completed", "tag": "b42c4fad-eada-45fb-8006-58c5896075f3"}, {"server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "name": "network-vif-plugged", "status": "completed", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:25.858759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:25.858759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:25.858759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:25.870520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Creating event network-vif-plugged:b42c4fad-eada-45fb-8006-58c5896075f3 for instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 on hv-cinder-80135 Sep 07 14:46:25.871028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] Creating event network-vif-plugged:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:46:25.877680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-efb66e57-51bc-444c-b602-8361ec7fba4f req-c3c5229e-0b27-48fd-a956-b738822c459c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.037607 Sep 07 14:46:25.878307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 47/90] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:25 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:26.036442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:26.036442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:26.040690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.041177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.041613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.042323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.042779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.043203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.067916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:26.069468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:26.075731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.078442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.078442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.078442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.078442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.078803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.243272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.262458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0ebb10ad-57cc-4a88-9e63-f7c139c68825 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.232145 Sep 07 14:46:26.267561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 44/91] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:26 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:26.270116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.279196 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:26.279196 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:26.281774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.284051 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.285384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c5e3cb61-4500-41de-ad5e-48009834388b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.221792 Sep 07 14:46:26.286161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 48/92] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:26 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:26.290959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.291665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.292417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.293299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.293913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.294516 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.336271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:26.340909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:26.355400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.356210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.357321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.358260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:26.358904 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:26.360980 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:26.489290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.496789 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-92161d76-6d66-4329-9cfb-f31744079a28 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.227972 Sep 07 14:46:26.497612 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 45/93] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:26 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:26.540263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:26.540263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-23b2db9a-9d78-4b1a-a23d-905b2d4a7f71 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.218347 Sep 07 14:46:26.541022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 49/94] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:26 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:27.289942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:27.290549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:27.296773 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.297262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.297699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.298387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.298869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.299291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.309789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:27.310388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:27.316360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.316835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.317266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.317935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.318967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.319413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.497829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.501539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.505523 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a8a924e2-0027-423c-a21f-cfce43399717 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.219646 Sep 07 14:46:27.506606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 46/95] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:27 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:27.510567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.512003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.513145 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9e1c966f-0602-4279-be01-03baef4b72f7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.207295 Sep 07 14:46:27.527600 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 50/96] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:27 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:27.527719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:27.527719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:27.527719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.527940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.528291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.529045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.529419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.529859 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.562915 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:27.563536 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:27.570209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.570696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.571132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.571824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.572305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.572741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.714212 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.721960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-dc2da5cc-49ad-45f6-b957-326fc9940291 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.206673 Sep 07 14:46:27.722609 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 47/97] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:27 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:27.736909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:27.745055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dc061e92-c470-4d06-882d-149bb81ea404 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.186026 Sep 07 14:46:27.745618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 51/98] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:27 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:27.899737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5f6be2-5405-4fec-9c2c-584b8e270d1a", "name": "network-vif-plugged", "status": "completed", "tag": "24b0bebe-bbc1-43a9-9520-065202c5da6c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:27.909107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:27.909572 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:27.910096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:27.921528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] Creating event network-vif-plugged:24b0bebe-bbc1-43a9-9520-065202c5da6c for instance be5f6be2-5405-4fec-9c2c-584b8e270d1a on hv-cinder-80135 Sep 07 14:46:27.926946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-6ba0e4ae-8320-438b-869d-5ceb2d2bc99f req-7cac81dc-7239-43d8-bf7c-efa87d207c6b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030449 Sep 07 14:46:27.927456 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 48/99] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:28.530315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:28.536466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:28.542520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:28.543033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.543129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:28.543281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.543715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.544431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.544888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.545314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.550132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.550751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.551181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.551891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.552444 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.553501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.771273 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:28.776636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:28.780015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-854c479d-a5fb-434b-a1a8-40d2af9a29dd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.253421 Sep 07 14:46:28.780621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 52/100] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:28 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:28.785187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:28.785799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:28.786445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:28.788885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:28.804283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-02711c4d-37ed-4745-904c-7d5c414e6bf7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.254945 Sep 07 14:46:28.804426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.804426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.804426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.804676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 49/101] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:28 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:28.804761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.804761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.804761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.810201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:28.818402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:28.825330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.826121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.826616 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:28.827382 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:28.830245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:28.830245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:29.003916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:29.014244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-14fb895c-cd35-4b63-9cf1-ca290668e993 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.231997 Sep 07 14:46:29.024177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 53/102] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:28 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:29.032983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:29.039014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6d6cc17f-5768-450f-aae3-f3ce4462c138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.232612 Sep 07 14:46:29.039755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 50/103] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:28 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:29.807419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:29.808227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:29.814108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:29.814584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:29.815010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:29.815691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:29.816165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:29.816592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:29.824953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:29.826265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:29.833601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:29.834135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:29.834587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:29.835460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:29.835907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:29.836434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.021520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.027338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.029756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9e26f999-6004-41aa-b421-1b8fead86b2e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.226848 Sep 07 14:46:30.030331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 54/104] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:29 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:30.038556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.040131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.041332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a1fa6ca6-ca17-43d2-bbba-8cc6b4a9d8ab tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.220350 Sep 07 14:46:30.042368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 51/105] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:29 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:30.042968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:30.043632 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:30.053120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:30.053624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:30.054068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.061612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:30.061612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:30.061612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.069017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:30.070125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:30.079211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:30.079714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:30.080171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.081026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:30.081486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:30.081904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.344818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.351411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:30.356210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aa3b2085-ad82-407d-9ee1-af7371c764b5 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.319335 Sep 07 14:46:30.357035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 55/106] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:30 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:30.361144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-32032072-c6fb-49ab-966e-ee5493920138 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.297265 Sep 07 14:46:30.362901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 52/107] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:30 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:30.425729 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301a5877-a659-4739-8532-4e44fe18c220", "name": "network-vif-plugged", "status": "completed", "tag": "2c86e722-7302-4ac6-a690-d68f41da2e37"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:30.438136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:30.438597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:30.439247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:30.461589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] Creating event network-vif-plugged:2c86e722-7302-4ac6-a690-d68f41da2e37 for instance 301a5877-a659-4739-8532-4e44fe18c220 on hv-cinder-80135 Sep 07 14:46:30.472513 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-33935c6e-b0d7-42c4-bad2-c07da915c9ff req-91bc993b-57b8-44b0-a54c-07b07a8e9aa0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050678 Sep 07 14:46:30.473123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 56/108] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:31.062886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:31.064075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:31.071396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:31.072076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:31.072331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.072827 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.073267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.073967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.074492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.074908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.078270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.079071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.079317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.080069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.080635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.081205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.467653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.470841 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.477263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cef763df-465b-4dfc-8e3c-a0067c21858e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.418076 Sep 07 14:46:31.477836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 53/109] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:31 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:31.480928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.482394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.483611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2fd596e9-ddfb-4ea4-924f-e1c1c3048f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.417113 Sep 07 14:46:31.492384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:31.493313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:31.494128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 57/110] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:31 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:31.501625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.502058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.502489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.506891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:31.507520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:31.515476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.515839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.516299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.517658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.517813 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.518089 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.520288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:31.520825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:31.521873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:31.747783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.756717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a5936235-b8ea-457e-ae00-77a62b633ba1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.260754 Sep 07 14:46:31.757219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 58/111] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:31 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:31.760831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:31.771962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2c03017e-b41e-4b2a-8561-7a55fc667a9f tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.290533 Sep 07 14:46:31.771962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 54/112] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:31 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:32.500282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:32.500896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:32.507108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.507587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.508065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.509190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.509803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.510383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.514139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:32.514742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:32.521268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.521799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.522162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.522878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.523275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.523689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.533872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:32.733451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:32.736467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:32.742906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-95f73a0c-fdf0-4b03-879a-0bb763fab44b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.246471 Sep 07 14:46:32.743701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 59/113] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:32 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:32.745275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:32.746891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:32.748000 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-41cd4272-fad6-43d8-8dfa-f20b8033c78e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.237780 Sep 07 14:46:32.748637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 55/114] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:32 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:32.781498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:32.782218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:32.794399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.794399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.794399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.794399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.794836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.794836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.795011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:32.795011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:32.800843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.801417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.801925 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:32.802723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:32.803251 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:32.803750 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:33.014420 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:33.022014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:33.022527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a9b509cb-ac39-47d9-a6d5-e57873b420d8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.246249 Sep 07 14:46:33.023466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 60/115] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:32 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:33.043969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-16a9ecff-ea4f-41c7-8449-beefc89b9187 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1315 microversion: 2.1 time: 0.254395 Sep 07 14:46:33.044653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 56/116] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:32 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1315 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:33.767423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:33.768045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:33.774704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:33.775188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:33.775629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:33.776352 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:33.776810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:33.777234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:33.787994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:33.787994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:33.787994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:33.787994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:33.788679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:33.788679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:33.788679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:33.788679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:33.988234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:33.991703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:33.998654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-01207bcf-effb-453a-a0a4-e39f071d214a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.235236 Sep 07 14:46:33.999270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 61/117] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:33 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:34.000975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:34.002577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:34.004186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6be863f1-0880-4eb6-b408-9168a06852d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1406 microversion: 2.20 time: 0.230675 Sep 07 14:46:34.004804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 57/118] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:33 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1406 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:46:34.047344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:34.048255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:34.058837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:34.058837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:34.058837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:34.058837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:34.059187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:34.059187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:34.066778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:34.067395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:34.074229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:34.074761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:34.075352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:34.075933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:34.076462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:34.076892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:34.081931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:34.263942 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:34.279684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:34.280774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f806a687-80cc-4664-a102-e763c32e8d1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.237678 Sep 07 14:46:34.285070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fcb7d087-19f2-4fbe-a492-e13fa666c507 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1503 microversion: 2.1 time: 0.222227 Sep 07 14:46:34.285642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 58/119] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:34 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1503 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:34.295914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 62/120] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:34 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:35.023366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:35.023990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:35.029935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.030427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.030842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.031514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.031960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.034320 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.041942 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:35.042554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:35.048509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.048993 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.049432 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.050124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.050604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.051026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.239759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:35.246793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:35.250445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e69657ba-7a70-429e-93e1-9e682ef2ec8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.231416 Sep 07 14:46:35.251500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 59/121] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:35 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:35.255749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:35.257288 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:35.258560 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-99a16621-a6bd-4225-8e69-def6e80254fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1599 microversion: 2.20 time: 0.220737 Sep 07 14:46:35.259177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 63/122] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:46:35 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1599 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:46:35.283719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:35.284240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:35.290683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.291162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.291599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.292315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.292767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.293187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.302566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:35.303235 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:35.310603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.318117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.318117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.318117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:35.318117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:35.318648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:35.474709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a99013cb-d60a-42e9-960a-d9d7f7d208c7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.194716 Sep 07 14:46:35.475369 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 60/123] 10.222.0.57 () {60 vars in 1316 bytes} [Wed Sep 7 14:46:35 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-interface => generated 285 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:46:35.532383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:35.541262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ad99eeda-3653-4294-b2f5-32613fcd9a74 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1321 microversion: 2.1 time: 0.242390 Sep 07 14:46:35.541839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 64/124] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:35 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1321 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:36.275342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:36.275954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:36.286223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.287336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.287912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.288785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.289384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.289974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.437696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:36.446048 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eb074c2e-805a-46cc-9bd3-e0b83a9c6607 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.175253 Sep 07 14:46:36.446602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 61/125] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:36 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:36.524286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b0129628-2bba-4e0c-bf8c-e7d06c1b9a7f"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:36.528725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:36.534964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.535443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.535873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.536596 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.537619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.537619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.565959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:36.566586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:36.573275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.574530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.574530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.574979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.575643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.576070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.759052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:36.768340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2c1607d6-7f2f-41b8-9234-551976855564 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1516 microversion: 2.1 time: 0.207019 Sep 07 14:46:36.768907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 62/126] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:36 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1516 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:36.791863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:36.794938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:36.801295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.802044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.807864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.807864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:36.807864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:36.807864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:36.837717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'flavor' on Instance uuid 301a5877-a659-4739-8532-4e44fe18c220 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:46:37.219868 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-62514750-0d43-4443-8645-fc6cd65f2b1e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220/action" status: 200 len: 32 microversion: 2.1 time: 0.431829 Sep 07 14:46:37.220775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 63/127] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:46:36 2022] POST /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220/action => generated 32 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 07 14:46:37.230603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:37.241824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:37.242541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:37.243001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:37.253686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] Creating event network-changed:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:46:37.258676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-6b1469c6-5c31-4f48-bd35-d1b99eb2bdc3 req-f6179ff9-e31e-42c9-99c1-7fe5ede82cca service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031940 Sep 07 14:46:37.259272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 64/128] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:37.267369 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:37.268270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:37.277624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:37.278803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:37.279411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:37.280308 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:37.280911 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:37.281500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:37.451225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:37.461757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cec920e7-7d4f-41a3-b200-fcf5dc62d5c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.201144 Sep 07 14:46:37.462318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 65/129] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:37 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:37.468965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:37.469570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:37.475916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:37.476436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:37.476874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:37.477563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:37.478014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:37.478436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:37.666605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:37.674978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9a0e650c-40bb-44e6-ad1b-3d9ea88389de tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.209409 Sep 07 14:46:37.675847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 66/130] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:37 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:38.487916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:38.488632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:38.495822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:38.497906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:38.497906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:38.497906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:38.498221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:38.498380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:38.632560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:38.640589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-160ca4b1-db1e-4ec6-bb8e-e9ee4efc0a29 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.156595 Sep 07 14:46:38.641198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 67/131] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:38 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:38.697530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:38.698137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:38.703944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:38.707553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:38.707553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:38.707553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:38.707553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:38.707883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:38.839780 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:38.847510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ae1e5b3d-0dde-4033-9de6-bc739d446160 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1366 microversion: 2.1 time: 0.153589 Sep 07 14:46:38.848072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 68/132] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:38 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:39.665288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:39.665886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:39.671799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:39.672317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:39.672754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:39.673444 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:39.673897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:39.674324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:39.811675 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:39.819838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bb4ed872-af21-4a52-afb5-e65bd29d5ea6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.159024 Sep 07 14:46:39.820433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 69/133] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:39 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:39.871211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:39.872788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:39.881544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:39.882030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:39.882704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:39.883598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:39.884422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:39.884976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:40.192760 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:40.204740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-958f823d-22e2-4966-b40a-184f9ff9e07d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1557 microversion: 2.1 time: 0.338468 Sep 07 14:46:40.222836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 70/134] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:39 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1557 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:40.230210 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:40.230733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:40.233731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:40.243451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:40.243978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:40.244446 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:40.247753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:40.247753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:40.247753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:40.413821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-337c1685-7bce-4f17-b861-0d99cd35c522 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.187199 Sep 07 14:46:40.414550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 71/135] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:46:40 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-interface => generated 285 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:46:40.693554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-006788c5-96a7-4f70-a1cd-ae7b1ae8d764 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "POST /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.173678 Sep 07 14:46:40.695393 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 65/136] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:46:36 2022] POST /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08/os-volume_attachments => generated 194 bytes in 4176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:40.853165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:40.854298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:40.871372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:40.872282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:40.872947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:40.874178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:40.874691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:40.878872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:41.510002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:41.535036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f7aabee6-9029-4349-9bcb-b9da21a7d113 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.688510 Sep 07 14:46:41.537338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 72/137] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:40 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 691 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:42.561917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:42.562627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:42.574553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:42.577003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:42.580072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:42.581211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:42.581824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:42.584956 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:42.600116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "be5f6be2-5405-4fec-9c2c-584b8e270d1a", "tag": "24b0bebe-bbc1-43a9-9520-065202c5da6c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:42.612684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:42.613164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:42.613594 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:42.652135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] Creating event network-changed:24b0bebe-bbc1-43a9-9520-065202c5da6c for instance be5f6be2-5405-4fec-9c2c-584b8e270d1a on hv-cinder-80135 Sep 07 14:46:42.671546 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-abba71b5-435c-4fe4-b55e-7eea15f73876 req-f9b771a2-3a63-4d25-a6af-4a3deffb202d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075502 Sep 07 14:46:42.675524 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 73/138] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:46:42.845428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:42.853987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e1db0399-71bd-4c39-9dd5-2c068ad6a9b7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.296649 Sep 07 14:46:42.870060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 66/139] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:42 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:43.878375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:43.879078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:43.886068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:43.886685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:43.894208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:43.894208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:43.894208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:43.894208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:44.032171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:44.038534 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:44.042951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7f0a2591-6fe6-48ad-87be-f263751b6b47 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.166711 Sep 07 14:46:44.042951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 74/140] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:43 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:45.065817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:45.066440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:45.070033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=81 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:45.073649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:45.074212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:45.074658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:45.075350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:45.075804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:45.076266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:45.211210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:45.219024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-82a839d5-eaf5-42e1-9978-00cb6816edfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.158540 Sep 07 14:46:45.219588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 67/141] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:45 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:46.244887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:46.245641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:46.252009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:46.252515 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:46.256037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:46.256037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:46.256037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:46.256037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:46.387063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:46.396711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0a11dd00-5783-49a0-afdd-5266e5e471bd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.156685 Sep 07 14:46:46.399031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 75/142] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:46 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:47.421744 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:47.423585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:47.430230 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:47.430734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:47.431160 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:47.431875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:47.432355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:47.432899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:47.582617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:47.591076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-73d04ae7-2409-4add-9f2f-535c5efa6902 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.173494 Sep 07 14:46:47.591738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 68/143] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:47 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:48.617866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:48.619003 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:48.627133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:48.627843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:48.628468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:48.629331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:48.630192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:48.631488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:48.842421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:48.847528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-678a995b-7b86-437e-8c11-d1ca8cb390f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.235090 Sep 07 14:46:48.848162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 76/144] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:48 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:49.870629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:49.874938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:49.878023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:49.878501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:49.879100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:49.879770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:49.880795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:49.881386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:50.033848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:50.042373 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-904cbb03-8f3f-4890-8719-686398f49678 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.175791 Sep 07 14:46:50.043189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 69/145] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:49 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:51.065392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:51.066039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:51.073029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:51.073585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:51.074094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:51.074853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:51.075385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:51.075881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:51.237560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:51.256172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24141d0c-2c77-4af6-9615-db4ee5309757 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.194602 Sep 07 14:46:51.259536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 77/146] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:51 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:52.284562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:52.298652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:52.298652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:52.298652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:52.298652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:52.299685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:52.299685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:52.299685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:52.688640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:52.694348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-575fe01f-5aef-49ec-a5fc-49d2484d8699 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.414011 Sep 07 14:46:52.713412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 70/147] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:52 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:52.820582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:52.821084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:52.828552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:52.828853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:52.829461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:52.830552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:52.831255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:52.831844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:52.864175 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:46:53.187646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cf9021cd-a4b3-4f82-9176-19a8642e3b75 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 204 len: 0 microversion: 2.1 time: 0.370831 Sep 07 14:46:53.188254 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 78/148] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:46:52 2022] DELETE /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:46:53.202864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:53.203676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:53.210486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:53.210976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:53.211427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:53.212352 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:53.212818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:53.213275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:53.351945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:53.361707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bb321bff-fff6-4321-855d-a75af63ced85 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1555 microversion: 2.1 time: 0.162782 Sep 07 14:46:53.362281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 71/149] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:53 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1555 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:53.719236 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:53.720279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:53.727233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:53.727717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:53.728165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:53.729052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:53.729656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:53.730232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:53.877076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:53.885650 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c444dc9-479c-4076-8520-ce174e3742d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.170531 Sep 07 14:46:53.886424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 79/150] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:53 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:54.391070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:54.391070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:54.400065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:54.401339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:54.401936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:54.402914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:54.403345 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:54.404093 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:54.577018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:54.586700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-35956951-a41f-4c1e-a3c1-d79859c5afd0 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1555 microversion: 2.1 time: 0.204649 Sep 07 14:46:54.589966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 72/151] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:54 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1555 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:54.909897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:54.910509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:54.917806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:54.918231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:54.918671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:54.919339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:54.919974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:54.922018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:55.175066 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:55.187312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-33b6b2a7-b02a-452b-9391-60c9b73f36fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.280946 Sep 07 14:46:55.187886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 80/152] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:54 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:55.617028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:55.617028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:55.628049 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:55.628600 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:55.636347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:55.637272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:55.638141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:55.638614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:55.922959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:55.933614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c60ff3b2-978e-4ce9-bcb2-de5bc8728b4c tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1555 microversion: 2.1 time: 0.325063 Sep 07 14:46:55.935021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 73/153] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:55 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1555 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:56.210086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:56.210712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:56.216579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:56.217138 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:56.217560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:56.218354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:56.218803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:56.219225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:56.419936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5eb777ae-e8d8-4d7c-85af-904ef78d3a08", "name": "network-vif-deleted", "tag": "b42c4fad-eada-45fb-8006-58c5896075f3"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:56.436701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:56.436922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:56.437358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:56.449184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] Creating event network-vif-deleted:b42c4fad-eada-45fb-8006-58c5896075f3 for instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 on hv-cinder-80135 Sep 07 14:46:56.454973 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-021b471b-5189-402d-9b95-2d2dad12f1d2 req-f51c7017-271f-44ed-8a9c-b615bbca1cbc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038579 Sep 07 14:46:56.456115 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 74/154] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:46:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:46:56.476527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:56.485573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24f4f6ed-4093-4564-a13c-b0eb8c72cd5f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.279248 Sep 07 14:46:56.486436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 81/155] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:56 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:56.971463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:56.971463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:56.971463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:56.971463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:56.972450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:56.972450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:56.972450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:56.972450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:56.992129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:46:57.039016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:57.067055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-86f64f25-3ad6-49fb-b706-6428210e3f3d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1346 microversion: 2.1 time: 0.111921 Sep 07 14:46:57.070105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 75/156] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:56 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1346 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:57.511271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:57.511271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:57.516956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:57.520903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:57.520903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:57.520903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:57.520903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:57.521297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:57.652564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:57.660448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c8ad937e-3a76-4c96-be04-9cebdde9d8dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.155261 Sep 07 14:46:57.661014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 82/157] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:57 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:57.864513 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1340303842", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "networks": [{"uuid": "570251e2-010a-4a4b-9d3d-b0f242e0f043"}]}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:46:57.932085 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] validate_networks() for [('570251e2-010a-4a4b-9d3d-b0f242e0f043', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:46:58.093530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:58.095041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:58.105318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.109096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.110003 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.110922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.114065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.116195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.187767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.188541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.189149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.189763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lazy-loading 'fault' on Instance uuid 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:46:58.243473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9f46e69140e347669da323ad08edd7e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd95dab0bcea84d42b8b92ce81606e2ec', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:58.251208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-78e7c86f-cbd6-41d3-bb02-9ff8752b234d tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 200 len: 1305 microversion: 2.1 time: 0.162573 Sep 07 14:46:58.253075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 83/158] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:58 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 1305 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:58.387906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:46:58.388460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:46:58.388846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:46:58.389611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:46:58.390035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:46:58.399761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.400272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.400743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.401484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.401933 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.402518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.426754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Getting quotas for project 2ed99ce2509c4163b314baa4cf3e5ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:46:58.431364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Getting quotas for user cfd87fa14f924cb897959950c79739ef and project 2ed99ce2509c4163b314baa4cf3e5ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:46:58.442503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:46:58.445409 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:46:58.560428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d807d94b-b506-41f7-9561-fbaaeb824fec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.700319 Sep 07 14:46:58.561297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 76/159] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:46:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 702 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:46:58.573159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5799e423-65df-464f-a843-ce2630fd2a5e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:58.574551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5799e423-65df-464f-a843-ce2630fd2a5e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:58.654321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5799e423-65df-464f-a843-ce2630fd2a5e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:58.668087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5799e423-65df-464f-a843-ce2630fd2a5e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1219 microversion: 2.1 time: 0.099334 Sep 07 14:46:58.668722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 84/160] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:58 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:58.683011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:58.683657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:58.692725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.693802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.694243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.695335 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:58.695785 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:58.696588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:58.831840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:58.841202 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-10b0b2bb-4067-436f-b5e8-45d385b366e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.161981 Sep 07 14:46:58.841781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 77/161] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:58 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:46:59.276720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:59.277325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:59.284426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.284870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.285632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:59.286326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.286782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.287785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:59.301671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] HTTP exception thrown: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Request method failure captured: Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 HTTP/1.1 Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6eKhICswAAvp64NuOCV9OGG68IOoI-VCtn4FyRyBCALxuwjnnPxlsKs5WO0u2p4b00ho8e38Go1EnjemQKKcjcAxRW2HRDYQpSecSqVPNLTGMbaRIG2d9iAA5vkwJvTjPeoWFTBG3TTvtB8E7iN1sAh58JHvl30rnnnO3rVRytAWM Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:46:59.306683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 9f46e69140e347669da323ad08edd7e5 Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.307977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '5eb777ae-e8d8-4d7c-85af-904ef78d3a08'} Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:46:59.308897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.310116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.311042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Returning 404 to user: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:46:59.311042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b59059d4-b5d3-4e00-9cf9-c18feeb9a1ca tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 404 len: 111 microversion: 2.1 time: 0.035548 Sep 07 14:46:59.311042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 85/162] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:59 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:46:59.597161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:59.601500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:59.612916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.618363 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.618963 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:59.619795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.620358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.620988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:59.636313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] HTTP exception thrown: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Request method failure captured: Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08/os-volume_attachments HTTP/1.1 Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6eKhICswAAvp64NuOCV9OGG68IOoI-VCtn4FyRyBCALxuwjnnPxlsKs5WO0u2p4b00ho8e38Go1EnjemQKKcjcAxRW2HRDYQpSecSqVPNLTGMbaRIG2d9iAA5vkwJvTjPeoWFTBG3TTvtB8E7iN1sAh58JHvl30rnnnO3rVRytAWM Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:46:59.641074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 9f46e69140e347669da323ad08edd7e5 Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.643657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'server_id': '5eb777ae-e8d8-4d7c-85af-904ef78d3a08'} Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:46:59.644848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:46:59.647123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:46:59.648566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Returning 404 to user: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:46:59.648566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bfdce9ce-7da8-4a3d-9662-c1b3bd25b801 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.049574 Sep 07 14:46:59.648566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 78/163] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:46:59 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08/os-volume_attachments => generated 111 bytes in 51 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:46:59.700026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ccbe6eaf-cfb6-48d9-8e9c-7e4162eefe35 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:59.702248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ccbe6eaf-cfb6-48d9-8e9c-7e4162eefe35 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:59.761097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ccbe6eaf-cfb6-48d9-8e9c-7e4162eefe35 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:46:59.769005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ccbe6eaf-cfb6-48d9-8e9c-7e4162eefe35 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1219 microversion: 2.1 time: 0.081830 Sep 07 14:46:59.769554 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 86/164] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:59 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:46:59.865562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:46:59.867541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:46:59.873967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.874456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.874888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:46:59.875587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:46:59.876100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:46:59.876562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:00.042304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:00.048611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7b0744f6-a3b9-4e1e-8025-6e989a195443 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.187316 Sep 07 14:47:00.049181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 79/165] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:46:59 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:00.793014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:00.793617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:00.799829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:00.800362 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:00.804885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:00.804885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:00.804885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:00.804885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:00.874197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:00.879875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7722643c-91e8-451f-9370-1b31ce318614 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1271 microversion: 2.1 time: 0.090633 Sep 07 14:47:00.881089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 87/166] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:00 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1271 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:01.074631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:01.076078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:01.089818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.089818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.089818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.089818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.090766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.090766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.112205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:01.112931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:01.121568 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.123257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.123857 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.125143 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.125812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.126704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.142988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] HTTP exception thrown: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Request method failure captured: Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 HTTP/1.1 Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6eKhICswAAvp64NuOCV9OGG68IOoI-VCtn4FyRyBCALxuwjnnPxlsKs5WO0u2p4b00ho8e38Go1EnjemQKKcjcAxRW2HRDYQpSecSqVPNLTGMbaRIG2d9iAA5vkwJvTjPeoWFTBG3TTvtB8E7iN1sAh58JHvl30rnnnO3rVRytAWM Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:47:01.144558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 9f46e69140e347669da323ad08edd7e5 Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.145825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '5eb777ae-e8d8-4d7c-85af-904ef78d3a08'} Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:47:01.147087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.148267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.149628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Returning 404 to user: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:47:01.149628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-894784e5-851f-4978-9da8-ce9ad089da87 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "DELETE /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 404 len: 111 microversion: 2.1 time: 0.038692 Sep 07 14:47:01.149628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 88/167] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:47:01 2022] DELETE /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:47:01.155078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:01.155712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] [instance: 5eb777ae-e8d8-4d7c-85af-904ef78d3a08] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:01.161614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.162136 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.162565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.163869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.163869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.164231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.179166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] HTTP exception thrown: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Request method failure captured: Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 HTTP/1.1 Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6eKhICswAAvp64NuOCV9OGG68IOoI-VCtn4FyRyBCALxuwjnnPxlsKs5WO0u2p4b00ho8e38Go1EnjemQKKcjcAxRW2HRDYQpSecSqVPNLTGMbaRIG2d9iAA5vkwJvTjPeoWFTBG3TTvtB8E7iN1sAh58JHvl30rnnnO3rVRytAWM Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:47:01.180718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/d95dab0bcea84d42b8b92ce81606e2ec"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: d95dab0bcea84d42b8b92ce81606e2ec Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-DeleteServersTestJSON-727103271 Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 9f46e69140e347669da323ad08edd7e5 Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-DeleteServersTestJSON-727103271-project Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.181843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '5eb777ae-e8d8-4d7c-85af-904ef78d3a08'} Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:47:01.182564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. Sep 07 14:47:01.184463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:47:01.185706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] Returning 404 to user: Instance 5eb777ae-e8d8-4d7c-85af-904ef78d3a08 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:47:01.185706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-55e95489-ca33-4a69-9b17-80eebeb7d565 tempest-DeleteServersTestJSON-727103271 tempest-DeleteServersTestJSON-727103271-project] 10.222.0.57 "GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08" status: 404 len: 111 microversion: 2.1 time: 0.030898 Sep 07 14:47:01.185706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 89/168] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:01 2022] GET /compute/v2.1/servers/5eb777ae-e8d8-4d7c-85af-904ef78d3a08 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 14:47:01.437795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:01.448019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-47376275-06ce-48ed-8bde-65c49e60b72a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.378696 Sep 07 14:47:01.454395 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 80/169] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:01 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:01.904837 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:01.905453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:01.917537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.918772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.921548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:01.922702 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:01.923517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:01.926366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:02.133148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:02.142410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f1dbc41e-e57b-40f2-acd1-e0f6319b6339 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1277 microversion: 2.1 time: 0.241380 Sep 07 14:47:02.142977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 90/170] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:01 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1277 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:02.477273 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:02.477948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:02.485737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:02.486268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:02.486829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:02.487403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:02.487861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:02.488616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:02.807135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:02.820597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dc3f4dcb-679f-40b5-922f-2e50c50680fa tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.346742 Sep 07 14:47:02.822114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 81/171] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:02 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:03.167086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:03.167739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:03.175321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:03.175834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:03.176298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:03.177150 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:03.178197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:03.178617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:03.533850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:03.552953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b6697a89-edea-413e-9d1f-1c3b3e82ed03 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.390756 Sep 07 14:47:03.554162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 91/172] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:03 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:03.845953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:03.847429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:03.859915 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:03.860576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:03.861435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:03.862288 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:03.863053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:03.863695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:04.166829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:04.174741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-02d10954-7c09-4fb9-9733-787e55b6f8c4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.333547 Sep 07 14:47:04.175305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 82/173] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:03 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:04.601081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:04.603139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:04.614842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:04.615419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:04.616495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:04.617474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:04.618135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:04.618914 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:04.873165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:04.881469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e8cd8e2e-3213-40f5-becb-9c24e5cb2f54 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.295418 Sep 07 14:47:04.907153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 92/174] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:04 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:05.122836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e66ab21-f377-46eb-8d32-3cdef7f06e73", "tag": "34ff295b-1c6a-439c-831f-6fa1379064a1"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:05.148270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:05.149045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:05.149849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:05.163488 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] Creating event network-changed:34ff295b-1c6a-439c-831f-6fa1379064a1 for instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 on hv-cinder-80135 Sep 07 14:47:05.169034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-5b5ad1a6-4a1d-498d-835c-309d4593ae36 req-cc99654b-93b7-4247-bb64-a3197cb3bcfc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049781 Sep 07 14:47:05.170242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 83/175] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:05.200465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:05.201496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:05.213908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:05.214505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:05.215573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:05.217850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:05.218319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:05.218752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:05.269677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:05.606104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:05.617375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1aad93e4-a090-4080-8596-b4e548e3e0bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.421560 Sep 07 14:47:05.618814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 93/176] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:05 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:05.918048 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:05.919734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:05.927211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:05.928620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:05.929639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:05.933746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:05.934450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:05.935411 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:06.249128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:06.260893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-44be79d5-ed48-4764-a6a5-9534d24a73a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.356560 Sep 07 14:47:06.264190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 84/177] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:05 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:06.643834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:06.645533 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:06.655773 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:06.656648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:06.657296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:06.658249 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:06.658916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:06.659737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:06.965690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:06.977554 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-901ca85e-0826-472c-b583-147b2278fa6e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.337765 Sep 07 14:47:06.994759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 94/178] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:06 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:07.283846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:07.284541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:07.292467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:07.293209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:07.293864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:07.294807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:07.295324 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:07.295992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:07.502952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:07.516172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0525cd17-c077-4fde-bf96-0c7e8106d524 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.236134 Sep 07 14:47:07.517155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 85/179] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:07 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:08.002196 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:08.002844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:08.010120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:08.010892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:08.011502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:08.012229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:08.012686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:08.013107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:08.189696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:08.200439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-921ca6df-3bdc-4704-9c5b-b226c86c4575 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.202203 Sep 07 14:47:08.201314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 95/180] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:07 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:08.544823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:08.544823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:08.545391 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:08.545728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=6 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:08.552123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:08.552659 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:08.553100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:08.553807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:08.554262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:08.554690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:08.846344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:08.855938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-19dc6932-bb89-4592-83c2-3ea3696a858d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.320158 Sep 07 14:47:08.856740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 86/181] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:08 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:09.226709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:09.227459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:09.234547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:09.235253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:09.235892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:09.237288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:09.238297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:09.239280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:09.386982 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:09.396589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5d0f4a29-70fa-4595-8269-8816686749f0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.174715 Sep 07 14:47:09.397725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 96/182] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:09 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:09.879607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:09.880766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:09.887140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:09.887620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:09.888070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:09.888794 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:09.889243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:09.889667 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:10.039314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:10.047792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6b3c6f0a-6288-460b-9b0a-6c83c429713c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.172474 Sep 07 14:47:10.048400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 87/183] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:09 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:10.419583 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:10.420221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:10.426429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:10.427940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:10.429569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:10.430069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:10.435943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:10.435943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:10.435943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:10.435943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:10.611722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:10.625721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8d562756-f8c4-47a4-8af2-f1a5c72f6b55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.210423 Sep 07 14:47:10.628652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 97/184] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:10 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:10.671796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e66ab21-f377-46eb-8d32-3cdef7f06e73", "name": "network-vif-plugged", "status": "completed", "tag": "34ff295b-1c6a-439c-831f-6fa1379064a1"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:10.682415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:10.682923 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:10.683517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:10.697753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] Creating event network-vif-plugged:34ff295b-1c6a-439c-831f-6fa1379064a1 for instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 on hv-cinder-80135 Sep 07 14:47:10.703101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-d15b70bc-71a3-4a44-87c8-bd9aef99a559 req-13b828a1-b0c1-41b1-beaf-6c49161c116a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038153 Sep 07 14:47:10.703688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 88/185] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:11.072824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:11.073453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:11.081871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:11.082287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:11.082964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:11.083929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:11.084628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:11.085243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:11.274069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:11.283060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-89bd887d-2d25-41fc-b78e-6d69d0dd2598 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.213778 Sep 07 14:47:11.292201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 98/186] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:11 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:11.653868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:11.654573 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:11.667654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:11.668177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:11.668698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:11.669439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:11.669896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:11.670326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:11.806733 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:11.814628 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cd6618ca-91e6-4fd0-9ee0-04840fc138bc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.166223 Sep 07 14:47:11.815204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 89/187] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:11 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:12.306439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:12.307363 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:12.314089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:12.314980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:12.314980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:12.315665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:12.316111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:12.316551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:12.490235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:12.498849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9ef42e80-e8be-4f69-9ed3-b81c29285784 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1319 microversion: 2.1 time: 0.196692 Sep 07 14:47:12.500621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 99/188] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:12 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:12.837914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:12.838538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:12.844969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:12.845449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:12.845887 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:12.846576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:12.847031 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:12.847453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:12.988608 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:12.996342 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9ea2db44-c7d4-44de-9328-d9d2e9293b2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.162756 Sep 07 14:47:12.996894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 90/189] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:12 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:13.307128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3233f3ab-f011-45a4-bfcb-1eff75b39732 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfac9940>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:13.400232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3233f3ab-f011-45a4-bfcb-1eff75b39732 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/cd586f5a-f64f-444b-ab19-06d99b7c7195" status: 200 len: 350 microversion: 2.1 time: 0.093824 Sep 07 14:47:13.400232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 100/190] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:47:13 2022] GET /compute/v2.1/os-volumes/cd586f5a-f64f-444b-ab19-06d99b7c7195 => generated 350 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:13.530291 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:13.531154 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:13.538234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:13.538721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:13.539158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:13.539854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:13.540347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:13.540803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:13.671209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:13.679724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dbabb363-9aa6-4b27-9020-67d04168dbd1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1509 microversion: 2.1 time: 0.155350 Sep 07 14:47:13.680470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 91/191] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:13 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:14.021988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:14.022677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:14.029460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:14.030063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:14.030501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:14.031193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:14.031676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:14.032102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:14.169113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:14.178530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ac92cfc3-2e53-4a94-b345-ca2a8fb39b68 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.160259 Sep 07 14:47:14.179179 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 101/192] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:14 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:15.136605 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0ea6f368-6a3b-42b8-931e-794e68dad501 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa670d0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:15.187602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0ea6f368-6a3b-42b8-931e-794e68dad501 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/fd8a7072-0517-4335-afb0-dd684c798d94" status: 200 len: 351 microversion: 2.1 time: 0.054986 Sep 07 14:47:15.188200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 92/193] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:47:15 2022] GET /compute/v2.1/os-volumes/fd8a7072-0517-4335-afb0-dd684c798d94 => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:15.202441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:15.203058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:15.208958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:15.209996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:15.210427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:15.211114 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:15.211563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:15.211983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:15.353243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:15.361547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-997e5136-1eb8-4952-8093-ef47da6a43ba tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1522 microversion: 2.1 time: 0.162998 Sep 07 14:47:15.362116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 102/194] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:15 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:16.385984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:16.387309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:16.394971 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:16.395469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:16.395907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:16.397347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:16.397813 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:16.398252 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:16.534507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:16.544572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1f1d5978-61f6-4c75-8e50-3a24705e94e4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1502 microversion: 2.1 time: 0.163614 Sep 07 14:47:16.545149 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 93/195] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:16 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1502 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:16.567535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:16.568214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:16.574359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:16.574845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:16.575280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:16.575981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:16.576647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:16.577081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:16.733844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:16.738084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-af41fdb2-252d-48d9-85fb-294084c01ecd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1516 microversion: 2.1 time: 0.174636 Sep 07 14:47:16.738649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 103/196] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:16 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1516 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:17.107298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a213f2c5-0c26-4ac9-aca1-bffb4d337863 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfb8a700>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.155190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a213f2c5-0c26-4ac9-aca1-bffb4d337863 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/3449fcab-3c0f-42ee-bb02-748ece5c3318" status: 200 len: 351 microversion: 2.1 time: 0.051743 Sep 07 14:47:17.155769 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 94/197] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes/3449fcab-3c0f-42ee-bb02-748ece5c3318 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:17.174377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3905f6ca-12f0-4739-95a9-13bb6887bdb8 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa2dca0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.262888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3905f6ca-12f0-4739-95a9-13bb6887bdb8 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.092180 Sep 07 14:47:17.263645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 104/198] 10.222.0.57 () {58 vars in 1134 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:17.278505 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-16b2def9-cd7b-4587-b251-e1512ba94efb tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfb8aee0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.363553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-16b2def9-cd7b-4587-b251-e1512ba94efb tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.088763 Sep 07 14:47:17.364126 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 95/199] 10.222.0.57 () {58 vars in 1149 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:17.377816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f71cd41b-5242-4e12-a285-a889d9c3893a tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa41310>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.464203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f71cd41b-5242-4e12-a285-a889d9c3893a tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.090075 Sep 07 14:47:17.464762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 105/200] 10.222.0.57 () {58 vars in 1134 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:17.483343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d626c1d2-b817-4453-a9a1-e8d4409c19c4 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa87ee0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.573749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d626c1d2-b817-4453-a9a1-e8d4409c19c4 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.094578 Sep 07 14:47:17.574323 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 96/201] 10.222.0.57 () {58 vars in 1167 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:17.588680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a75b2c8f-2d3c-48c3-b556-016dcf45e38f tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa41dc0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.672279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a75b2c8f-2d3c-48c3-b556-016dcf45e38f tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.087975 Sep 07 14:47:17.672847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 106/202] 10.222.0.57 () {58 vars in 1170 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:17.687192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5a2461e1-7105-4456-9927-6cbe18c591b7 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa673a0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.789514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5a2461e1-7105-4456-9927-6cbe18c591b7 tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.105999 Sep 07 14:47:17.790081 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 97/203] 10.222.0.57 () {58 vars in 1155 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:17.804285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-90e0ad85-2b3e-42d9-b578-04f1088fc05f tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfa2d310>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.886840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-90e0ad85-2b3e-42d9-b578-04f1088fc05f tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.086737 Sep 07 14:47:17.887434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 107/204] 10.222.0.57 () {58 vars in 1188 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:17.901283 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d943ba46-f338-48cc-8780-78ea644461bb tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] Calling method '.version_select at 0x7fefdfb8ac10>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:17.986066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d943ba46-f338-48cc-8780-78ea644461bb tempest-VolumesTestJSON-1241692232 tempest-VolumesTestJSON-1241692232-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.088472 Sep 07 14:47:17.986703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 98/205] 10.222.0.57 () {58 vars in 1155 bytes} [Wed Sep 7 14:47:17 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:18.562214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:18.564774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:18.570685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:18.571266 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:18.571701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:18.572425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:18.572883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:18.573310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:18.595885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'flavor' on Instance uuid 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:47:18.824438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1c6b2469-3b66-4ff0-8e16-6d6a72d1af8e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/action" status: 200 len: 32 microversion: 2.1 time: 0.266038 Sep 07 14:47:18.825410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 108/206] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:47:18 2022] POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/action => generated 32 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:47:18.836401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:18.837080 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:18.840004 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:18.844884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:18.848208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:18.848208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:18.848208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:18.848208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:18.848567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:19.041427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:19.049825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c0eee80a-3783-4893-94b0-36f99912311a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.218465 Sep 07 14:47:19.050402 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 99/207] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:18 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:20.077488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:20.078547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:20.090703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:20.091241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:20.091683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:20.092413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:20.092864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:20.096597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:20.239874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:20.248181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5ce3506e-a121-45db-b038-53a749dacf1c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.175562 Sep 07 14:47:20.265492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 109/208] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:20 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:21.276603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:21.277215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:21.283737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:21.284295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:21.284894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:21.285589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:21.286050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:21.286478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:21.437727 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:21.442172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:21.447645 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0e722d4e-23e3-47a6-b7e5-960b5db80636 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.175839 Sep 07 14:47:21.448216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 100/209] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:21 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:22.472948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:22.474400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:22.483972 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:22.484975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:22.486184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:22.487766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:22.488204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:22.492696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:22.659618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:22.677625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bc09e7e9-b644-4414-b40d-ea2aaac23f46 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.210480 Sep 07 14:47:22.693804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 110/210] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:22 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:23.701383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:23.702077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:23.723154 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:23.733139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:23.733139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:23.733139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:23.733139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:23.733743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:23.895950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:23.896995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:23.903152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:23.903867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:23.904514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:23.905365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:23.905957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:23.906521 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:23.935425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7aced6a4-de69-4952-b284-b359160c4589 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/ips" status: 200 len: 153 microversion: 2.20 time: 0.043449 Sep 07 14:47:23.936461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 111/211] 10.222.0.57 () {60 vars in 1289 bytes} [Wed Sep 7 14:47:23 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 14:47:23.940194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:23.948992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fbaaf75f-f222-4b87-bbe9-158c2fd94873 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.251223 Sep 07 14:47:23.949575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 101/212] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:23 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:24.979996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:24.980685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:24.986597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:24.987073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:24.987557 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:24.988267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:24.988709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:24.989125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:25.167033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:25.175221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bd4367d1-c329-4c4e-a941-d94ca0739420 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.199104 Sep 07 14:47:25.175790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 112/213] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:24 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:26.198885 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:26.199509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:26.206027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.206774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.207225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.207940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.208423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.208851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.344860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:26.352778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-61c20c96-df53-46a7-9b40-d9cd0bd79a38 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.157728 Sep 07 14:47:26.353344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 102/214] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:26 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:26.564134 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:26.565305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:26.572966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.573509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.573880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.574660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.575391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.576040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.597897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:26.603902 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lazy-loading 'flavor' on Instance uuid ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:47:26.754337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:26.754844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:26.761591 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.764501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.764501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.764501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:26.764501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:26.764859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:26.787772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-96e71ddd-873a-48e5-ab38-41ef7ebbf4aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/ips" status: 200 len: 151 microversion: 2.1 time: 0.037834 Sep 07 14:47:26.788582 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 103/215] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:47:26 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:27.380985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:27.380985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:27.387618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:27.388312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:27.388943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:27.390862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:27.391855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:27.393118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:27.602279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:27.611167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fe9cfb7e-b868-407a-aa86-e5f198e1c380 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.239390 Sep 07 14:47:27.612481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 104/216] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:27 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:28.641037 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:28.641037 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:28.653038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:28.653577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:28.654019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:28.656222 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:28.660240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:28.660695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:28.826135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:28.835522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-757a2aad-686d-409b-9c28-5a08a9768ec2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.204651 Sep 07 14:47:28.836123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 105/217] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:28 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:28.842192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62921461-3282-4f4f-bc1e-7deae1fba834"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:28.848477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:28.851448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:28.852857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:28.853719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:28.854748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:28.855773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:28.856917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:29.590446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-976a1ccc-9dcb-42c5-b435-151c6384c36a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.752207 Sep 07 14:47:29.591050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 106/218] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:47:28 2022] POST /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 194 bytes in 754 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:29.862160 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:29.863239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:29.872092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:29.878994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:29.880122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:29.880910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:29.881423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:29.882632 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:30.021491 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:30.030110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b36d5795-a8f6-40e1-98f0-5ec71333aa39 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.172445 Sep 07 14:47:30.033041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 107/219] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:29 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:30.533498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-829269479", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "networks": [{"uuid": "9c92af15-fa8b-47c1-90b7-39fd738ae00c"}]}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:32.628996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e7043f2d-7383-495e-b08e-09a12a13ef8f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/action" status: 202 len: 0 microversion: 2.20 time: 6.068589 Sep 07 14:47:32.630668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 113/220] 10.222.0.57 () {62 vars in 1319 bytes} [Wed Sep 7 14:47:26 2022] POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/action => generated 0 bytes in 6071 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:47:32.633896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] validate_networks() for [('9c92af15-fa8b-47c1-90b7-39fd738ae00c', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:47:32.654662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:32.656018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:32.662666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:32.663888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:32.664566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:32.665471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:32.666113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:32.666722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:32.880954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:32.890098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ac95b1c8-7dff-455b-b34e-47f5fcf7f867 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.257609 Sep 07 14:47:32.890684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 114/221] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:32 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:32.902449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:32.903048 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:32.909100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:32.909586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:32.910025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:32.910726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:32.911175 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:32.911603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:33.119403 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:33.137682 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:33.139878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:33.141110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-deadbcaf-eebd-4068-8dd4-21c40dd3cd89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.249320 Sep 07 14:47:33.143579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 115/222] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:32 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:33.159084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:47:33.159084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:47:33.159084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:47:33.159084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:47:33.159084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:47:33.167992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:33.168549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:33.168983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:33.169712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:33.170167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:33.170688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:33.189957 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Getting quotas for project 2497a9df3f354a5789cc9f7735e39828. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:47:33.194286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Getting quotas for user 0fb67f4c58934a568fedf74dc9d45c8d and project 2497a9df3f354a5789cc9f7735e39828. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:47:33.205994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:47:33.208326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:47:33.358521 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2228361e-ed1d-4727-97cd-6d7b35575696 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.828843 Sep 07 14:47:33.359342 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 108/223] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:47:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 2830 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 07 14:47:33.371318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f52adef2-45d2-4d8b-87b4-fb55781f9032 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:33.371856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f52adef2-45d2-4d8b-87b4-fb55781f9032 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:33.431545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f52adef2-45d2-4d8b-87b4-fb55781f9032 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:33.438758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f52adef2-45d2-4d8b-87b4-fb55781f9032 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1213 microversion: 2.1 time: 0.071738 Sep 07 14:47:33.441830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 116/224] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:33 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1213 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:33.913429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:33.914025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:33.920775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:33.921277 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:33.921718 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:33.922419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:33.922856 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:33.923282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:34.056297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:34.064227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-37f10f66-13cf-4c09-9c7a-8a6aa56c0276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.155173 Sep 07 14:47:34.064788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 109/225] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:33 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:34.175328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:34.175876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:34.182318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:34.182804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:34.183238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:34.183929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:34.184407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:34.184832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:34.328136 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:34.336310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:34.337754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:34.338903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d7c91a95-43bf-4273-b43a-ba5b81a59fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.167517 Sep 07 14:47:34.339453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 117/226] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:34 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:34.461195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4b41ccbd-40bf-40ce-b8a5-8edccdfffd61 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:34.461741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4b41ccbd-40bf-40ce-b8a5-8edccdfffd61 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:34.516291 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4b41ccbd-40bf-40ce-b8a5-8edccdfffd61 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:34.523337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4b41ccbd-40bf-40ce-b8a5-8edccdfffd61 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1213 microversion: 2.1 time: 0.066064 Sep 07 14:47:34.523894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 110/227] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:34 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1213 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:35.088520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:35.089126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:35.095465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.095888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.096352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.097037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.097485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.097906 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.223753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:35.232176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-39c0c4e5-9828-4c1d-934f-5c41dbcc4de4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.147904 Sep 07 14:47:35.232746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 118/228] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:35 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:35.363922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:35.364480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:35.371497 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.371984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.372452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.373144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.373600 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.374029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.498310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:35.506808 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:35.508273 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:35.509428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b7e58eef-4d95-498f-85aa-3e868a51b68f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.149516 Sep 07 14:47:35.509990 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 111/229] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:35 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:35.546141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:35.546748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:35.552656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.553166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.553599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.554287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:35.554742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:35.555166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:35.617707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:35.625487 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-83373c94-10a8-483c-ae7e-834c0b80a962 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1217 microversion: 2.1 time: 0.083185 Sep 07 14:47:35.626037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 119/230] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:35 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1217 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:36.255198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:36.255712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:36.261812 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.262297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.262736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.263421 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.263912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.264429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.410626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:36.419890 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-62eb5923-9c12-44e2-b418-8eea706a96c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.168602 Sep 07 14:47:36.420652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 112/231] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:36 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:36.534816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:36.535375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:36.542033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.542604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.543064 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.543965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.544447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.545063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.655035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:36.655871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:36.663758 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.664385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.664899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.665749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:36.666199 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:36.666620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:36.694252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:36.703390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:36.704864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:36.706026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d11cb844-1d6b-4a96-a601-d05ce8a882c8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.175186 Sep 07 14:47:36.706579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 120/232] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:36 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:36.738389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:36.752201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a8a12625-a0f9-426c-a410-40d1c1727a55 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1265 microversion: 2.1 time: 0.102314 Sep 07 14:47:36.753876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 113/233] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:36 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1265 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:37.447695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:37.448571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:37.455377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.455922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.456474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.459412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.459412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.459412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.604038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:37.613252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5b5d1375-c31d-4a30-91cf-3f89faa322f1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.170229 Sep 07 14:47:37.614069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 121/234] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:37 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:37.733731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:37.735534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:37.755467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.756680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.757451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.758494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.759901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.762060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.776083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:37.776519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:37.783511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.784062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.784588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.785360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:37.785886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:37.786367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:37.909807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:37.919166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2bd64bec-17b2-4716-be47-bfffefb32e0a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1265 microversion: 2.1 time: 0.147156 Sep 07 14:47:37.919965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 122/235] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:37 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:38.037158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:38.046257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:38.047696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:38.049823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2203ed28-197f-4597-b522-efc8cb67e4c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.319709 Sep 07 14:47:38.049823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 114/236] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:37 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:38.253594 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f3dab90f-3bb5-4e67-8f9c-398223b19c46 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: .version_select at 0x7fefdfa2dd30>, body: {"keypair": {"name": "tempest-keypair-2137689577", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGGisIN/Dzjx8VQjgvLGhD3VAhxwJf8v6JH30sXtwCwPVMVCvoqqVladPigiDDvIF6tIGNLZruUCnlPVXe5FOnuoemFsjlXvudb9DaisUmaJ92zy5RDdMxOf+0SMCMZUxg=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:38.269657 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f3dab90f-3bb5-4e67-8f9c-398223b19c46 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:47:38.278152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f3dab90f-3bb5-4e67-8f9c-398223b19c46 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:47:38.357588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f3dab90f-3bb5-4e67-8f9c-398223b19c46 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114987 Sep 07 14:47:38.358444 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 123/237] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:47:38 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:38.638209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:38.638824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:38.645144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:38.645782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:38.646215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:38.647654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:38.648032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:38.648490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:38.895666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:38.904760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-efea0c95-4703-457c-a6ea-d47f407ec413 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.270284 Sep 07 14:47:38.905342 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 115/238] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:38 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:38.945094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:38.945712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:38.951712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:38.952229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:38.952665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:38.953367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:38.953893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:38.954314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:39.075023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:39.075674 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:39.081579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:39.082059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:39.082579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:39.083265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:39.083733 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:39.084169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:39.186955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:39.194720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-97ee8824-29d2-4390-93ee-5b33fac90429 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.255083 Sep 07 14:47:39.195284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 124/239] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:38 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:39.342151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:39.351952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:39.353635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:39.354807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4693070a-a63f-4724-be6f-1cb1a44d3161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.283704 Sep 07 14:47:39.355672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 116/240] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:39 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:47:39.938876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:39.938876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:39.942667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:39.943968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:39.944456 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:39.946607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:39.947147 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:39.947522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.047044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5", "tag": "1755d82e-c308-4964-b51b-b9ec546eea12"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:40.061602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:40.062300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:40.062962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.075669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] Creating event network-changed:1755d82e-c308-4964-b51b-b9ec546eea12 for instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 on hv-cinder-80135 Sep 07 14:47:40.081404 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-b63de0e2-c488-4f62-b632-50b25d68549a req-020be284-bab1-4b39-a5ce-3838b5f8925d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038369 Sep 07 14:47:40.082896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 117/241] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:40.195865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:40.204047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-67fd551a-c82d-457f-b6c2-650a3df298d2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.280123 Sep 07 14:47:40.204724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 125/242] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:39 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:40.222097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:40.222811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:40.229743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:40.230221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:40.230648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.231330 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:40.231776 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:40.232211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.383692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:40.384723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:40.393301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:40.394351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:40.394943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.395823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:40.397177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:40.397773 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:40.476113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:40.479375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:40.486988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aef34ba1-0800-477b-a738-eb2d05b8b9ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.268669 Sep 07 14:47:40.488820 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 118/243] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:40 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:40.591665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:40.601218 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:40.602928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:40.603798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9fcb8c32-a46b-437b-9358-e0c6f143d533 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.226119 Sep 07 14:47:40.604519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 126/244] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:40 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:40.835666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1915823918", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "163090f4-fd08-48b4-a9ef-0baf5dc14d96"}], "security_groups": [{"name": "tempest-securitygroup--1091943987"}], "key_name": "tempest-keypair-2137689577", "user_data": "}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:41.004376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] validate_networks() for [('163090f4-fd08-48b4-a9ef-0baf5dc14d96', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:47:41.228878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:41.230242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:41.236994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.237625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.238215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.239565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.240246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.240735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.708321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:41.719759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-677f55fa-6955-40c6-a632-e1dadb8dbbfb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.495889 Sep 07 14:47:41.720686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 127/245] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:41 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:41.725943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:41.726550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:41.730562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:47:41.731051 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:47:41.731446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:47:41.731867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:47:41.732293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:47:41.733038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.733365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.733799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.734492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.734946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.735482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.744074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.744890 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.745544 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.746512 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.747278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.748005 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.768634 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:47:41.773778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:47:41.785586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:47:41.788619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:47:41.870051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:41.877721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-00b59e42-a25c-4cc1-a838-cd0d20458656 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.155924 Sep 07 14:47:41.878496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 128/246] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:41 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:41.882752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:41.883349 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:41.889384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.889774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.890850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.891949 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:41.892588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:41.893153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:41.948038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a14b00db-3e5f-4208-8da8-1c27da8f1754 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.117067 Sep 07 14:47:41.949462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 119/247] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:47:40 2022] POST /compute/v2.1/servers => generated 402 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:47:41.962472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5747cb6a-252f-4eb3-b0c8-de5d892acd4a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:41.963509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5747cb6a-252f-4eb3-b0c8-de5d892acd4a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:42.049027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5747cb6a-252f-4eb3-b0c8-de5d892acd4a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:42.061128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5747cb6a-252f-4eb3-b0c8-de5d892acd4a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1242 microversion: 2.1 time: 0.104554 Sep 07 14:47:42.062280 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 120/248] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:41 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1242 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:42.097697 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:42.106548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:42.108132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:42.109466 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a80268f6-6450-41c3-8cc9-d9571bec519e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.230219 Sep 07 14:47:42.110074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 129/249] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:41 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:42.743444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:42.744084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:42.751137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:42.751622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:42.752060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:42.755109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:42.755109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:42.755109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:42.886721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:42.894823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a20385cf-5d7a-4860-887f-3edd9db523c1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.155816 Sep 07 14:47:42.896806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 121/250] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:42 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:42.902576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:42.903831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:42.907383 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:42.911250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:42.912079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:42.913282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:42.914147 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:42.914666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:42.915151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:42.919426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:43.062059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:43.071287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-979d2b3b-0786-4cbd-aa08-a69df6eaeae6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.173304 Sep 07 14:47:43.071871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 130/251] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:42 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:43.088090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:43.095009 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:43.106975 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.107486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.107937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:43.110829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.111336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.111775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:43.136671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:43.136671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:43.149278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.149793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.150229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:43.150947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.152119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.156552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:43.276750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:43.286522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-954f6f3e-1704-4648-a7f8-a302adbc6385 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1246 microversion: 2.1 time: 0.203851 Sep 07 14:47:43.295011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 122/252] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:43 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1246 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:43.459407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:43.468377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:43.469727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:43.470911 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-02cadb51-fac1-40bb-8e37-b3c1efbbcc45 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.340234 Sep 07 14:47:43.471466 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 131/253] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:43 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:47:43.918035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:43.918788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:43.925113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.928951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.928951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:43.928951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:43.929927 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:43.930843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.096528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:44.097830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:44.105815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.107501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.108740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.109472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.111063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.111722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.112552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.116071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2ccb9905-6fd5-439d-90f8-150962a5a251 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.201654 Sep 07 14:47:44.118954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 123/254] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:43 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:44.313323 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:44.314058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:44.323450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.325691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.327357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.327548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.328287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.331957 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.336351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.348523 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-399a3a27-8574-4021-bcf0-18c7e2f72beb tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.257144 Sep 07 14:47:44.349101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 132/255] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:44 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:44.358670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "22c3d58e-1419-4346-bb3c-f185b76268ed", "device": "/dev/sdb"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:44.361630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:44.374985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.375615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.376269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.377355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.377963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.378636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.405428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.414914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8101b519-ef27-4ce8-84f7-1ad513dc4f87 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1294 microversion: 2.1 time: 0.106938 Sep 07 14:47:44.416045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 124/256] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:44 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1294 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:44.498541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:44.499229 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:44.508445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.509397 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.510360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.512395 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:44.513221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:44.514559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:44.669250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.677565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.679507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:44.683850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dbc65b86-97c3-41ba-867c-598f1b2ab538 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.190556 Sep 07 14:47:44.684490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 125/257] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:44 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:47:45.145847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:45.147780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:45.165159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.166869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.172873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.176985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.176985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.176985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.485729 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:45.497097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f3944087-94cf-428e-acf2-ac893b63a6d5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.361419 Sep 07 14:47:45.498635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 126/258] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:45 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:45.504412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:45.505115 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:45.521319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.521997 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.522619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.523330 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.523784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.524234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.595511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e02fd408-7c64-4f9b-8fa8-d15cb050ae3c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "POST /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.240051 Sep 07 14:47:45.596030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 133/259] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:47:44 2022] POST /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73/os-volume_attachments => generated 194 bytes in 1242 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:45.614900 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:45.614900 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:45.640404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.643400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.644300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.645785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.648091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.648967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.786821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:45.791716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:45.795779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0fbf728a-bb9d-4764-9500-8c27f8c17f85 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.296026 Sep 07 14:47:45.805715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 127/260] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:45 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:45.805715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:45.805715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:45.811265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.811757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.812220 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.812350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c2e72884-d396-44da-96fa-8168d5ee861d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1300 microversion: 2.1 time: 0.214969 Sep 07 14:47:45.813039 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:45.813653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:45.814244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:45.814861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 134/261] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:45 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1300 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:46.048822 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:46.058401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:46.059385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:46.060592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4d094d66-8fed-4e63-b5bc-46144831aa77 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.263258 Sep 07 14:47:46.061151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 128/262] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:45 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:46.521660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:46.522361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:46.529062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.529542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.529972 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:46.530655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.531103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.531634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:46.784624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:46.792949 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0562d043-9361-45a0-b96c-847fd0c94e2d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.275940 Sep 07 14:47:46.793517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 135/263] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:46 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:46.820759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:46.821379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:46.828124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.828641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.829079 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:46.829771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.830223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.830643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:46.839598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:46.840397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:46.852018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.852853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.853392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:46.854208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:46.854781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:46.855305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.230253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:47.243002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-76ce1786-0cfd-4fee-bbc8-2e1c449afb08 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.425873 Sep 07 14:47:47.243621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 129/264] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:46 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:47.248318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:47.249114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:47.255081 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:47.255562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:47.256199 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.257042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:47.257500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:47.258084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.262439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:47.270637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a0e728db-c2a0-4233-aa6e-47700bdad4d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.435940 Sep 07 14:47:47.272037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 136/265] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:46 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:47.533640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:47.541797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:47.543226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:47.544407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-04d04dcd-f112-4fd5-a5e6-64e0f8f1f741 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.299863 Sep 07 14:47:47.545213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 130/266] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:47 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:47.683356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbc686c-776f-41cd-96ee-331395bc2204", "tag": "6266f7d7-1f76-4249-87ce-c231a8e55ee0"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:47.693297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:47.694510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:47.694934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.816598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:47.817208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:47.838338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:47.838931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:47.839264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.840020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:47.840509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:47.840934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:47.911135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] Creating event network-changed:6266f7d7-1f76-4249-87ce-c231a8e55ee0 for instance 6cbc686c-776f-41cd-96ee-331395bc2204 on hv-cinder-80135 Sep 07 14:47:47.921575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-4b1a36ad-ad6f-4b23-a20e-68f476b7b5b2 req-492a7128-c96b-41b7-b04a-4d347232661f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.240922 Sep 07 14:47:47.922420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 137/267] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:47.997347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.005375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e7fa0e0a-5e67-4d9f-805a-c90ddfe9c158 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.192478 Sep 07 14:47:48.006745 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 131/268] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:47 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:48.266338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:48.267289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:48.273583 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.274004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.274440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.275129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.275582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.276021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.291073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:48.294802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:48.298902 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:48.298902 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:48.302121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.303380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.303821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.304567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.305028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.305448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.484240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.491939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.492663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-dde8c832-d024-47fa-bdc0-feb136e9ed91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.230463 Sep 07 14:47:48.493226 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 138/269] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:48 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:48.500025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ed1fe8f9-a730-4ba1-aa35-ef6d9fb48256 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.209749 Sep 07 14:47:48.500654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 132/270] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:48 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:48.570166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:48.570766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:48.576836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.577309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.577734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.578424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:48.578870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:48.579288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:48.725694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.733990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.735283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:48.736505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cafd5b72-e6c8-46d1-9f77-68854ca7ef4d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.171077 Sep 07 14:47:48.738899 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 139/271] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:48 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:49.030453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:49.031070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:49.037834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.038320 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.038755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.039963 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.040440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.040869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.301380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:49.309328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-872663e8-22c3-49ad-8008-b18376b16d3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.283123 Sep 07 14:47:49.309896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 133/272] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:49 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:49.517544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:49.523173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:49.524678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:49.525326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:49.534539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.540553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.540679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.540762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.540839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.540930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.541009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.541082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.541082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.541214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.541286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.541357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.844665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:49.849056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:49.853245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1af638d2-5ce8-4c72-b01d-0ed84cf9a348 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.339781 Sep 07 14:47:49.853808 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 140/273] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:49 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:49.861948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ec6fd73d-b549-4110-9cf1-3abc1960b792 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.337637 Sep 07 14:47:49.861948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 134/274] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:49 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:49.862135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5", "name": "network-vif-plugged", "status": "completed", "tag": "1755d82e-c308-4964-b51b-b9ec546eea12"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:49.869756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.870224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.870570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:49.870976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.871493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:49.884825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] Creating event network-vif-plugged:1755d82e-c308-4964-b51b-b9ec546eea12 for instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 on hv-cinder-80135 Sep 07 14:47:49.886773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.890358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-70e90f4f-d1e4-46e5-8214-c59480de213a req-5591acdf-2ecb-449d-a5c6-b2a2229abb32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034643 Sep 07 14:47:49.891096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 141/275] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:49.891454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.892448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:49.894466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:49.898249 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:49.899296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.143356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:50.153487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:50.155170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:50.156367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8a26acd4-0b85-444b-9776-1316eef4034f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.290701 Sep 07 14:47:50.156919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 135/276] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:49 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:50.336593 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:50.337585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:50.346351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.347262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.347920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.348861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.349603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.350184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.744968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:50.752921 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-205858b9-19eb-4aba-91a6-8d5ddc7ae82f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.422660 Sep 07 14:47:50.753755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 142/277] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:50 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:50.876275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:50.876809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:50.878508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:50.879120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:50.883140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.883621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.884064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.884773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.885223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.885332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.885651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.885765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.886126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:50.886890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:50.887343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:50.887765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:51.385765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.393113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.394885 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-af6b2416-8d1e-446d-a2f9-821401bbb643 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.522517 Sep 07 14:47:51.395629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 136/278] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:50 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:51.403906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:51.406673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:51.410157 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6751755c-e43b-4cc0-9bc2-577ec0e328e8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.535280 Sep 07 14:47:51.410986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 143/279] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:50 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:51.413383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:51.413899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:51.414349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:51.415048 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:51.415506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:51.415934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:51.420080 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:51.549530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.558125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.559537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.560728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-35d3c1e6-d233-4ee1-a232-b62629b0c349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.163774 Sep 07 14:47:51.561268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 137/280] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:51 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:51.777458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:51.778055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:51.785024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:51.785538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:51.785972 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:51.786667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:51.787133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:51.787562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:51.922940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:51.932501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c6c192cc-f99d-4965-a14e-6d5df44fe316 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.158798 Sep 07 14:47:51.933073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 144/281] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:51 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:52.420238 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:52.420847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:52.422746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=4 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:52.423866 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=16 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:52.429096 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.430082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.430517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.431217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.431669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.432094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.433474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:52.434120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:52.440474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.440967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.441398 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.442084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.442539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.442970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.672320 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:52.677563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:52.680323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0dce8719-5f2f-4f86-97e0-85567f9eccc4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.251158 Sep 07 14:47:52.691037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 145/282] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:52 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:52.691037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:52.691037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:52.691549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-83958e95-a043-493e-8b67-650c9621d036 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1313 microversion: 2.1 time: 0.274364 Sep 07 14:47:52.691741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 138/283] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:52 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1313 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:52.701936 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.714084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.714084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.714084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.714084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.714917 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.852031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:52.855654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:47:52.861097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:52.862549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:52.863793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b23a43b1-9792-4d83-b609-a5b1ff06be4a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.181538 Sep 07 14:47:52.864379 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 146/284] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:52 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:52.956363 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:52.959374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:52.962962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.963452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.963888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:52.964609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:52.965092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:52.965734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.097429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:53.105517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-44c91f2f-84c3-4a91-a760-0a3b300e7971 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.153103 Sep 07 14:47:53.109516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 139/285] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:52 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:53.705249 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:53.705849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:53.714030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:53.717096 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:53.717222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.717222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.717222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.717222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.717561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.717561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.723038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.723897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.724719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.725946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.727311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.727741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.940931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:53.947987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:53.949120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-595d2632-33c8-4a9d-8951-c6a77c543ccf tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.248032 Sep 07 14:47:53.949815 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 147/286] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:53 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:53.954499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:53.955440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:53.958899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7d69a1e7-b046-414b-bc9b-2874305977b2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1496 microversion: 2.1 time: 0.249120 Sep 07 14:47:53.960129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 140/287] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:53 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1496 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:53.962459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.962954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.963386 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:53.964097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:53.964647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:53.965079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:54.111661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:54.120261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:54.121721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:54.124082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9e335088-7a68-42f5-b723-64dcb21d7bef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.172113 Sep 07 14:47:54.124082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 148/288] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:53 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:54.129773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:54.130484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:54.137444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:54.138005 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:54.138539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:54.139322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:54.140002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:54.140613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:54.276908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:54.286248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-087e4169-9823-4db8-b38c-bfd1c70c1b30 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.160701 Sep 07 14:47:54.286824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 141/289] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:54 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:54.975604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:54.978419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:54.983354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:54.983831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:54.984597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:54.985298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:54.985748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:54.986168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.025570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:55.026124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:55.032411 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.032897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.040821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.040821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.040821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.040821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.061498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:47:55.121528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.129195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0f9fc8d1-5f73-40b8-adf0-6a47dadb8ceb tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.157652 Sep 07 14:47:55.129750 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 149/290] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:54 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:55.148597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:55.149216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:55.155057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.155618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.156062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.156782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.157239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.157668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.293479 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eb1a61b6-d224-4757-82c1-860df2e33e40 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "DELETE /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 204 len: 0 microversion: 2.1 time: 0.271487 Sep 07 14:47:55.294254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 142/291] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:47:55 2022] DELETE /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:47:55.304654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:55.304654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:55.309641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.310130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.310634 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.310989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.311328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.311779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.312228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.322178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.322841 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.324008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0d42dd09-1d9f-457a-a232-35a2becaccfb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.179621 Sep 07 14:47:55.333449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 150/292] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:55 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:47:55.338591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:55.339296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:55.352450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.352949 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.353619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.354402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:55.355317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:55.355434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:55.549928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.563420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7453b96a-2ba2-4df9-9171-ba8dbf114826 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.229027 Sep 07 14:47:55.569780 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 151/293] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:55 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:55.595895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:55.604200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d9cfb368-bf28-4ba5-9c17-2b34bca5e91c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.305606 Sep 07 14:47:55.604931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 143/294] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:55 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:56.152012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:56.152655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:56.164796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.164796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.164796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.164796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.165587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.165587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.307079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.314912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d25864cb-ff9f-40fc-bd67-4b4b1cbdf26f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.166736 Sep 07 14:47:56.315480 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 152/295] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:56 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:56.355399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:56.356308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:56.363568 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.364184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.364757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.365539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.366158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.366689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.507343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.515681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.517704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.518721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-40b715c6-d94b-4d53-8de7-33872de87643 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.167744 Sep 07 14:47:56.519304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 144/296] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:56 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:56.587531 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:56.588798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:56.597447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.597938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.600481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.600481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.600481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.600481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.636672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:56.637289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:56.643741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.644242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.644709 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.645423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:56.645869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:56.646288 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:56.797786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.808580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ccb63a79-7a32-4d38-aaf3-33fa24f81a55 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.225073 Sep 07 14:47:56.809181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 153/297] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:56 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:56.828345 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:56.837341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-30124b91-10e4-44dd-85d9-37990fdea8d6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.212740 Sep 07 14:47:56.837928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 145/298] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:56 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:57.336391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:57.337542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:57.344173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.344673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.345109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.345806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.346257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.346689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.495265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:57.503910 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4b33eac8-70f4-4b6a-8463-8ea753674a19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.171523 Sep 07 14:47:57.504575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 154/299] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:57 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:57.544871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:57.545478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:57.552026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.552518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.552953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.553949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.554582 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.555152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.594182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc686c-776f-41cd-96ee-331395bc2204", "name": "network-vif-plugged", "status": "completed", "tag": "6266f7d7-1f76-4249-87ce-c231a8e55ee0"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:47:57.604933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.607595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.607595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.617014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] Creating event network-vif-plugged:6266f7d7-1f76-4249-87ce-c231a8e55ee0 for instance 6cbc686c-776f-41cd-96ee-331395bc2204 on hv-cinder-80135 Sep 07 14:47:57.622207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-f1120e8d-0480-48ad-b3d0-8f6d872ecf23 req-b28e0e64-0f4b-48d7-9c44-3488add29a1c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036078 Sep 07 14:47:57.622820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 155/300] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:47:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:47:57.699427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:57.708680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:57.711136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:57.712101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7bc69677-00b7-4298-975f-664c30b0c381 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.171406 Sep 07 14:47:57.712934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 146/301] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:57 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:57.834079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:57.834912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:57.841707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.842193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.842649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.843321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.843777 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.844231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.861688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:57.862402 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:57.868450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.875451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.875451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:57.875451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:57.875451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:57.875876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:58.048602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.052652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.056608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e20f0dfd-2b59-4fc3-8733-8914a00b3be7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.226811 Sep 07 14:47:58.057186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 156/302] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:57 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:58.060576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bfbc6661-e427-493f-b855-9491848ac74b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.202837 Sep 07 14:47:58.061123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 147/303] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:57 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:47:58.526685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:58.527303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:58.533802 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:58.534282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:58.534718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:58.535410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:58.535860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:58.536415 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:58.669317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.677102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-33f69ea8-6cdd-4aa5-b764-59c3fdd43407 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.154300 Sep 07 14:47:58.677671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 157/304] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:58 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:58.736511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:58.737121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:58.744225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:58.744716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:58.745157 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:58.745962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:58.746581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:58.747244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:58.883313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.891529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.893227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:58.894368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fcea26b8-c1b8-4c50-9b37-1d65e1bbc8bb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.161789 Sep 07 14:47:58.894940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 148/305] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:58 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:47:59.079603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:59.080458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:59.083306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:59.083922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:59.087331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.087820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.090391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.090391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.090391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.090391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.090804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.091294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.091734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.092457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.092915 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.093368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.286767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:59.294590 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-629c8a5b-f49d-49cf-8ec0-0da0b5e6c313 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.219038 Sep 07 14:47:59.295166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 158/306] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:59 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:59.301839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:59.309653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ebb398c9-366f-4992-86c6-383c5514c1f8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.230123 Sep 07 14:47:59.310209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 149/307] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:59 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:59.700452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:59.701056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:59.707427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.707961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.708424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.709098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.709739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.710347 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.840015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:47:59.847578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c4c2b634-78be-4645-be99-10fecc26d0a7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.151084 Sep 07 14:47:59.848137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 159/308] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:47:59 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:47:59.919662 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:47:59.920309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:47:59.926707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.927190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.927660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:47:59.928356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:47:59.928818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:47:59.929747 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.059900 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:00.067895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:00.069372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:00.070571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6c427bdf-c38a-49bd-b35f-5eb9d5faf690 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.154870 Sep 07 14:48:00.071130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 150/309] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:47:59 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:00.321277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:00.322110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:00.328235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.328662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.329093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.329812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.330264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.330683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.333023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:00.334152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:00.340081 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.340598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.341033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.341725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.342176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.342797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.538206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:00.547754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c33c7c3d-059e-4a6e-8aa0-33e28448c333 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.230189 Sep 07 14:48:00.548287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 160/310] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:00 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:00.548424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:00.556368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d92f4111-a940-46ec-b4f2-d016fb2b06c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.227045 Sep 07 14:48:00.557068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 151/311] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:00 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:00.870469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:00.871090 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:00.877478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.877958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.878444 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:00.879144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:00.879580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:00.880103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.011069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.019005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-293b0bab-7e68-48de-936f-ee800bd197d4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.152621 Sep 07 14:48:01.019566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 161/312] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:00 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:01.096854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:01.096854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:01.102138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.102569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.103003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.103690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.104167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.104588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.108653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:01.231197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.239106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.240622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.242310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dd8ae2f8-9c9a-48fd-a3d5-b492c0d7f004 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.150651 Sep 07 14:48:01.242861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 152/313] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:01 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:01.574181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:01.574793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:01.578736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:01.579349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:01.580941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.581284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.581720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.582423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.582881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.583301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.585762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.586244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.586676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.587363 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:01.587815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:01.588267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:01.778190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.790873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:01.793052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8e96fade-dca3-4b4f-9337-a40c3f9df325 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.222670 Sep 07 14:48:01.793881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 162/314] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:01 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:01.802381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-52c1fadb-1acb-4f6c-86e3-d0908da89a73 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.227353 Sep 07 14:48:01.803183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 153/315] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:01 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:02.042264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:02.042892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:02.049315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.049790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.050286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.050941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.051391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.051806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.183627 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:02.191393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-62df02ee-818f-442f-9700-7d5d53fe946c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.153627 Sep 07 14:48:02.191959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 163/316] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:02 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:02.268307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:02.268914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:02.276015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.276547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.276989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.277683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.278131 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.278613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.414262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:02.427275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:02.428777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:02.429987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-061f8753-cf75-4faa-b3a0-79742378bd02 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.165998 Sep 07 14:48:02.430539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 154/317] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:02 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:02.818413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:02.819027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:02.827467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:02.828159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:02.829394 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.829894 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.830700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.831585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.832045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.832688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.836849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.837132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:02.837919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.838524 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:02.839227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:02.840389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:02.841140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.022270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.030240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a2f15112-c86f-49e5-a2f8-ba43c0e0fcd8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1502 microversion: 2.1 time: 0.215590 Sep 07 14:48:03.033738 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 164/318] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:02 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1502 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:03.048449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.055178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05e12008-49f8-4035-a29e-9eab95ce5210"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:03.057632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:03.058012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e121463d-9bce-4e89-8039-3bd82ba0f983 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.235024 Sep 07 14:48:03.059332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 155/319] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:02 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:03.063833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.064352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.064794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.065494 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.065955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.066376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.090676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] HTTP exception thrown: Cannot 'attach_volume' instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 while it is in vm_state rescued Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Request method failure captured: Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/os-volume_attachments HTTP/1.1 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 74 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6hSJxdBi6eEy6U9AQlNuLcma5FbEFn44tj3RQeLKfgEKdoowbpvTF_UVgUzE5NXQn2-y_elTJqTzevwbeUEK_CCealAstti6cpYWMHC_7Pyywly0rLWZcEZrBoCjwhepRwxzij_WunQhGHq4SBmj70yE600gbZNaSdoeBkSKHl7oQ Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:48:03.093107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6869744faba14c0bb69be840cea600f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6869744faba14c0bb69be840cea600f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 9d8116d648d64a62af52d9db6a607e13 Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {"volumeAttachment": {"volumeId": "05e12008-49f8-4035-a29e-9eab95ce5210"}} Sep 07 14:48:03.094449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Cannot 'attach_volume' instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 while it is in vm_state rescued Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'server_id': '74bb9f3f-4ce1-4649-997e-77d7079c6ee9', 'body': {'volumeAttachment': {'volumeId': '05e12008-49f8-4035-a29e-9eab95ce5210'}}} Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:48:03.095181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 while it is in vm_state rescued Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:03.096659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 while it is in vm_state rescued Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Returning 409 to user: Cannot 'attach_volume' instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 while it is in vm_state rescued {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bb853d36-f190-4357-b0e1-12dd2c918b3b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.044209 Sep 07 14:48:03.098041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 165/320] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:48:03 2022] POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 07 14:48:03.104638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:03.105173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:03.111132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.111624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.112059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.112837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.113331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.113757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.213408 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:03.214031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:03.220342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.220849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.221279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.221969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.222420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.222841 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.298447 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d8185e2f-7dcc-4b0f-8efc-90730abc8708 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/action" status: 202 len: 0 microversion: 2.1 time: 0.197954 Sep 07 14:48:03.299065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 156/321] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:48:03 2022] POST /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:48:03.308234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:03.308890 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:03.315309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.315786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.326429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.326429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.326429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.326429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.372176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.385427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d7d8c4db-178f-4523-999d-77d92da9cfca tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.175300 Sep 07 14:48:03.400806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 166/322] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:03 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:03.455823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:03.456828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:03.463239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.463722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.464168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.464879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:03.465332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:03.465756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:03.478187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.486376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f3df2ed5-d681-456b-ba08-64b3592ce298 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.182827 Sep 07 14:48:03.486938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 157/323] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:03 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:03.606629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.615241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.617581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:03.618903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9d38fe73-f919-4f38-8cac-93e54fd5700d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.167936 Sep 07 14:48:03.619893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 167/324] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:03 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:04.081149 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:04.090715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:04.090715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.090715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.090715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.091057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.091057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.091057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.263618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.271784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fa06750a-b0ae-4740-b9dc-82924a60c274 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1502 microversion: 2.1 time: 0.194604 Sep 07 14:48:04.272359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 158/325] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:04 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:04.310556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5", "name": "network-vif-deleted", "tag": "1755d82e-c308-4964-b51b-b9ec546eea12"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:04.321142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.321621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.322050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.333164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] Creating event network-vif-deleted:1755d82e-c308-4964-b51b-b9ec546eea12 for instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 on hv-cinder-80135 Sep 07 14:48:04.338253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-472ac03c-6054-4f42-a58e-1c04157f58e3 req-0bc231a2-6fa8-4881-b2eb-946245b2ccc3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031383 Sep 07 14:48:04.338830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 168/326] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:04.411835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:04.412480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:04.418672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.419274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.419707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.420809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.421266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.421711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.514068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:04.514923 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:04.522709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.523261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.523806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.524705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.525456 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.526059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.562840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.570685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4e7a30f1-7c00-4097-9323-df9ec7d66420 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.163620 Sep 07 14:48:04.572906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 159/327] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:04 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:04.645260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:04.645991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:04.652029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.652557 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.652991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.653689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:04.654144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:04.654570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:04.660394 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.668653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f69289e1-91f8-4f89-a927-214643cffe81 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.160155 Sep 07 14:48:04.676343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 169/328] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:04 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:04.783570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.792403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.793965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:04.795082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5e5557e1-7eba-44ba-b88e-e8f877af449a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.154207 Sep 07 14:48:04.795633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 160/329] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:04 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:05.302699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:05.306379 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:05.309432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.309868 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.310303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.311177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.312274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.312702 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.347356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.347836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.348366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.348723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:05.402344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:05.412025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c908c3dc-9694-4697-8a72-ebf949878e00 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.113168 Sep 07 14:48:05.412747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 170/330] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:05 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:05.593200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:05.594396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:05.600732 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.602019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.602523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.603723 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.604421 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.605044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.691677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:05.693063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:05.713426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.714029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.714573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.715366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.715887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.716394 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.887040 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:05.900818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-67b4b3db-7bd3-4223-913b-80412a89c25d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1368 microversion: 2.1 time: 0.311662 Sep 07 14:48:05.901401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 161/331] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:05 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1368 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:05.928078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:05.930170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:05.939665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.940278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.940919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.941952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:05.942627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:05.943313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:05.977344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:05.991989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3204a1d5-34c9-421b-a7ea-6a0bd1bedfa9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.303802 Sep 07 14:48:05.993445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 171/332] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:05 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:06.181486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:06.190984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:06.192527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:06.193886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-137bbe77-8a01-4578-befb-5d35f8e9de4e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.286956 Sep 07 14:48:06.199633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 162/333] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:05 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:06.445866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:06.446510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:06.452966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:06.453438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:06.453866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:06.454534 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:06.454978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:06.455391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:06.493122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:06.493599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:06.494033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:06.494473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:06.544904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:06.553001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5b9b6040-4329-4155-ad54-0e4235e0de02 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.111096 Sep 07 14:48:06.556642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 172/334] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:06 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:06.925168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:06.925779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:06.931842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:06.932359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:06.932793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:06.933476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:06.933923 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:06.934343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.019748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:07.020478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:07.027712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.028226 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.028665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.029367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.029821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.030262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.457104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.464788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-506e08c2-3d51-43c0-8238-699dfe858628 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1558 microversion: 2.1 time: 0.543713 Sep 07 14:48:07.465345 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 163/335] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:06 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1558 bytes in 545 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:07.469922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:07.470609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:07.481721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.483526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.484018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.484505 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.485205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.485661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.486122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.490182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-16435589-c6e6-4233-ae65-a3c747ae6d94 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.474980 Sep 07 14:48:07.490953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 173/336] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:07 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:07.496124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:07.496636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:07.502245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.506271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.506271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.506271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.506271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.506616 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.626110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0bf916e2-e822-458d-9946-9afd6c036916 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133282 Sep 07 14:48:07.628470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 174/337] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:48:07 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/os-interface => generated 284 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:07.633673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:07.634868 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:07.643231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.643896 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.644904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.645861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.646696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.647433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.687424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:07.688238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:07.688673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:07.689112 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:07.701668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.711896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.713766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.715030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a068f225-a208-4b81-b723-8b6ef0fb4adc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.248604 Sep 07 14:48:07.715926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 164/338] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:07 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:07.734351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:07.751663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ef1d2df6-94e6-4255-9081-a5927f788fde tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.114022 Sep 07 14:48:07.752658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 175/339] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:07 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:08.449787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "name": "network-vif-plugged", "status": "completed", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:08.461340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.461908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.462575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.474647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] Creating event network-vif-plugged:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:48:08.479562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-269b440e-02df-4472-ae12-6764254f9c15 req-d0e8605b-4114-491d-9035-4e29cddbbe19 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036264 Sep 07 14:48:08.480204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 165/340] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:08.513605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:08.514248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:08.521093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.521486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.521920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.522611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.523689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.524545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.741216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:08.744767 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:08.745476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:08.751969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f693bbe4-d9fa-4c0d-aacb-d1794b94baf6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.241720 Sep 07 14:48:08.753733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 176/341] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:08 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:08.774372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.775095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.775611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.776537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.776918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:08.777422 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.777665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:08.778003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.779959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:08.786214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.786790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.787291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.788054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.788765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.789550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.827809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:08.828571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:08.829071 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:08.829697 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:08.884288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:08.901770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c26fd131-9964-45ea-8a0e-f68901e618ee tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.121834 Sep 07 14:48:08.901770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 177/342] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:08 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:08.960516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:08.969929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:08.972922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:08.974316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-183103b9-ba46-4545-9755-63410c76f844 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.236858 Sep 07 14:48:08.974862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 166/343] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:08 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:08.996512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6cbc686c-776f-41cd-96ee-331395bc2204", "tag": "6266f7d7-1f76-4249-87ce-c231a8e55ee0"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:09.008904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.009385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.009808 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.021811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] Creating event network-changed:6266f7d7-1f76-4249-87ce-c231a8e55ee0 for instance 6cbc686c-776f-41cd-96ee-331395bc2204 on hv-cinder-80135 Sep 07 14:48:09.026864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-0be39e05-7712-4e4d-a541-cf02c4b79826 req-11b8a608-44f5-4030-8cb6-3f5b6033cbbf service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037791 Sep 07 14:48:09.027457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 178/344] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:09.779892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:09.780511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:09.787107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.792909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.797965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.798772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.799252 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.801800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.916982 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:09.917686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:09.925673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.932995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.933774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.934880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.935418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.935782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.961505 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:09.977430 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:09.979514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-891ffdb8-a943-4053-9a63-47b60d72f75c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.203330 Sep 07 14:48:09.980555 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:09.981081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:09.981541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 167/345] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:09 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:09.981657 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:10.007019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:10.008243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:10.018485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:10.018485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:10.018485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:10.018485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:10.018823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:10.018823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:10.028072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:10.041103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eac63e46-792e-465c-b30d-e560604a02ab tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.128800 Sep 07 14:48:10.042782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:10.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 179/346] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:09 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:10.185150 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:10.193868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:10.195315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:10.196522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eaddafdd-47b8-456a-a422-4b33a70a8a39 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.194184 Sep 07 14:48:10.197089 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 168/347] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:10 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:11.003427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:11.004037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:11.011159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.011638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.012064 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.012772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.013229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.013630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.076944 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:11.077598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:11.084508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.084992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.085799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.086498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.086977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.087387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.121486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.121973 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.122440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.122898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:11.177370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:11.181250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:11.186768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e0bff040-7059-4952-93bd-9044d9c9ef90 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.114390 Sep 07 14:48:11.187336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 169/348] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:11 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:11.189733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bcaf948b-13a3-4b4b-be9b-f719188cec78 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.190127 Sep 07 14:48:11.190289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 180/349] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:10 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:11.221690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:11.222396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:11.228608 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.229090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.229503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.230177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:11.230620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:11.232134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:11.362373 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:11.371410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:11.372883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:11.374042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b39a4036-52a0-4ab7-93a9-93310c8fa371 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.156735 Sep 07 14:48:11.374595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 170/350] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:11 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:12.211156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:12.211765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:12.213914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:12.214519 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:12.218359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.218842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.219272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.219961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.220440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.220801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.221065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.221274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.221754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.222386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.222832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.223251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.225140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:12.253350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.253859 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.254291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.254729 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:12.316195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:12.324318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2d98e5ae-1df1-4fe7-a9c9-022a222a3648 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.117769 Sep 07 14:48:12.324890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 181/351] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:12 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:12.378634 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:12.386995 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a736d553-e350-4693-80d1-1210e73455ad tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.177570 Sep 07 14:48:12.387658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 171/352] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:12 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:12.399814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:12.400454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:12.406432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.406914 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.407351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.408037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:12.408550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:12.408981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:12.535007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:12.543090 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:12.544560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:12.545714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e435306b-00c1-4adc-955e-67006ad01ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.150526 Sep 07 14:48:12.546273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 182/353] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:12 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:13.346739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:13.347346 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:13.354518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.354993 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.355423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.356107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.356595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.357014 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.386345 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.386816 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.387249 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.387689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:13.413174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:13.415365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:13.422622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.423248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.423690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.424406 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.424893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.425311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.434952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:13.443527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1a7b2dc2-21b8-42f1-bf4e-6e230016c98a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 200 len: 1303 microversion: 2.1 time: 0.100522 Sep 07 14:48:13.444107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 172/354] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:13 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:13.559081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:13.567452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ce1f01cf-571a-46e0-a0b5-3ef561be93d4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1510 microversion: 2.1 time: 0.159286 Sep 07 14:48:13.568023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 183/355] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:13 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:13.572271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:13.572271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:13.579946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.580604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.581050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.581803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:13.582392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:13.583791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:13.724566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:13.734824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:13.740954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:13.742191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-38e1af69-a284-4d26-816d-0757d6dc620d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1745 microversion: 2.20 time: 0.175236 Sep 07 14:48:13.746068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 173/356] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:13 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:14.468476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:14.469250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:14.479312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:14.480462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:14.481024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:14.482290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:14.483133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:14.484334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:14.505875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] HTTP exception thrown: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Request method failure captured: Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 HTTP/1.1 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK8AiQPswZGmyxknLolh7e96baviyBuRxv1Gk-H2z8cmqeuezZOSeaAuS7fwmPWjLE2gz2CFmFrBcDNHSt4wto2V4Pt7M_lyQVy5aOMQ94HVEsgStNrPl9rKSz_KFksGU6I5xvJBDxsqL7cDCzlBmtQKgQfmKwmI5amE4dAox5J0Qpo Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2497a9df3f354a5789cc9f7735e39828 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:48:14.508668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2497a9df3f354a5789cc9f7735e39828 Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesActionsTest-1168063084-project Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 0fb67f4c58934a568fedf74dc9d45c8d Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesActionsTest-1168063084-project Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. Sep 07 14:48:14.509908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5'} Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:48:14.510658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. Sep 07 14:48:14.512918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:14.514721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Returning 404 to user: Instance 46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:48:14.514721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fa6c9e9c-037c-467f-a5ea-ca9c09e2575a tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5" status: 404 len: 111 microversion: 2.1 time: 0.046451 Sep 07 14:48:14.514721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 184/357] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:14 2022] GET /compute/v2.1/servers/46f7c8ad-ea5c-48ad-aef4-ee8a9112e7b5 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:14.597221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:14.597221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:14.605780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:14.606272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:14.606708 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:14.607412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:14.610136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:14.610611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:14.733529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1098712144", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "networks": [{"uuid": "9c92af15-fa8b-47c1-90b7-39fd738ae00c"}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:14.812284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] validate_networks() for [('9c92af15-fa8b-47c1-90b7-39fd738ae00c', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:48:14.874204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:14.882737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d79c860b-53a3-4145-b3f1-d4e98ac7101f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1516 microversion: 2.1 time: 0.294464 Sep 07 14:48:14.890492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 174/358] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:14 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1516 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:14.898843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-37904811", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:15.052807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] validate_networks() for None {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:48:15.623473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:48:15.624507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:48:15.631985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:48:15.631985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:48:15.631985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:48:15.635865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:15.636915 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:15.637581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:15.638938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:15.639715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:15.640443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:15.667664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:48:15.667664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:48:15.667664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:48:15.667664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:48:15.667664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:48:15.677673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:15.680182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:15.682526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:15.682526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:15.684878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:15.685371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:15.685819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:15.698684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Getting quotas for project c7e0ace10fe241aba9f2ab06d05b0032. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:48:15.708990 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Getting quotas for user 133ae50f4b814e978c875bf61a9db611 and project c7e0ace10fe241aba9f2ab06d05b0032. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:48:15.723503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:48:15.727283 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:48:15.728593 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Getting quotas for project 2497a9df3f354a5789cc9f7735e39828. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:48:15.736608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Getting quotas for user 0fb67f4c58934a568fedf74dc9d45c8d and project 2497a9df3f354a5789cc9f7735e39828. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:48:15.750267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:48:15.752711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:48:16.270878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dceb4f71-a437-4394-8d0f-49ffac51d5b7 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.378985 Sep 07 14:48:16.271636 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 175/359] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1381 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:48:16.277151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:16.278483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:16.282897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-94e9070d-ac55-44d0-8499-06e59a9da523 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.548507 Sep 07 14:48:16.292137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 185/360] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:48:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 1564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:48:16.295326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:16.296069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:16.296835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:16.298706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cc30b990-4137-406f-be9d-e6f196a78679 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:16.299542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cc30b990-4137-406f-be9d-e6f196a78679 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:16.299989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:16.301495 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:16.305354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:16.369598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cc30b990-4137-406f-be9d-e6f196a78679 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:16.381110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cc30b990-4137-406f-be9d-e6f196a78679 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1213 microversion: 2.1 time: 0.087180 Sep 07 14:48:16.382011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 186/361] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:16 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1213 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:16.400434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fb53e865-9570-4c57-ae2a-cb63b58dab41 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:16.401377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fb53e865-9570-4c57-ae2a-cb63b58dab41 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:16.530227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fb53e865-9570-4c57-ae2a-cb63b58dab41 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:16.540854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fb53e865-9570-4c57-ae2a-cb63b58dab41 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1214 microversion: 2.1 time: 0.157488 Sep 07 14:48:16.549246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 187/362] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:16 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1214 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:16.595565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:16.605233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:16.606799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:16.608068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d07b6be7-2eae-4733-a5af-921c9818a90b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.335339 Sep 07 14:48:16.608725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 176/363] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:16 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:17.405468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3986507e-1777-4ebe-8c75-8233a70e1e18 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:17.406131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3986507e-1777-4ebe-8c75-8233a70e1e18 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:17.468708 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3986507e-1777-4ebe-8c75-8233a70e1e18 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:17.484357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3986507e-1777-4ebe-8c75-8233a70e1e18 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1213 microversion: 2.1 time: 0.082197 Sep 07 14:48:17.484357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 188/364] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:17 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:17.563465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:17.564930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:17.572619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:17.577329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:17.577329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:17.577948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:17.578765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:17.579406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:17.639570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:17.640241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:17.661250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:17.661759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:17.662391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:17.663157 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:17.663608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:17.664029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:17.703053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:17.712987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4b5901c6-9064-4855-910a-624d347a0953 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1218 microversion: 2.1 time: 0.153893 Sep 07 14:48:17.716616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 177/365] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:17 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:17.868279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:17.877660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:17.879529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:17.880992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-76453580-2a55-44d3-ad95-a91bb47d9e73 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.251124 Sep 07 14:48:17.899208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 189/366] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:17 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:18.508533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:18.509368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:18.518192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.519108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.519892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.520919 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.521603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.523180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.637843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:18.646111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b7d1b20d-78d8-44ec-a157-232786e6bf0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1217 microversion: 2.1 time: 0.142142 Sep 07 14:48:18.646662 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 178/367] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:18 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1217 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:18.737892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:18.738526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:18.745668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.746144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.746569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.747303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.747814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.748299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.813676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:18.821553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e40c49f3-ca36-4c1b-aff3-6f80cc0b483f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1210 microversion: 2.1 time: 0.087878 Sep 07 14:48:18.822104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 190/368] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:18 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1210 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:18.909360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:18.909787 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e57f3ea4-289b-4b8c-85a8-065543a8a50b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: .version_select at 0x7fefdfbf8ee0>, body: {"keypair": {"name": "tempest-keypair-2097183700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBD4FXXx0MQmPAOp5ifccEM1ZzJJdEujX+ekTfINgoNRPpNXqa2bxGwIF1jUPHyA57Tnen/fEQf9Xr10AMZWF9VYa+fft+ckj4JAL9ecPtSzTzWOSWjA0cq6hnY+drf4iLw=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:18.909981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:18.923329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.923829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.924295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.925002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:18.925454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:18.925755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-e57f3ea4-289b-4b8c-85a8-065543a8a50b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for project 6869744faba14c0bb69be840cea600f0. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:48:18.925891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:18.930152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-e57f3ea4-289b-4b8c-85a8-065543a8a50b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for user 9d8116d648d64a62af52d9db6a607e13 and project 6869744faba14c0bb69be840cea600f0. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:48:19.018452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e57f3ea4-289b-4b8c-85a8-065543a8a50b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.112352 Sep 07 14:48:19.019720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 191/369] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:48:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:48:19.070913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:19.081315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:19.083387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:19.085336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bc8439b9-2b7e-43f5-b6fb-02fb52d9b0b0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.179641 Sep 07 14:48:19.088868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 179/370] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:18 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:19.680203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:19.681116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:19.691984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:19.692538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:19.692967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:19.695441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:19.696049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:19.696505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:19.768201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:19.777170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5506a8c8-9763-4de6-9894-dceec9e8413f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1209 microversion: 2.1 time: 0.108111 Sep 07 14:48:19.780474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 192/371] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:19 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1209 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:19.844170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:19.844878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:19.852563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:19.863583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:19.864331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:19.865095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:19.865562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:19.866011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:19.969185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:19.981606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3ab81b6d-3d90-4d45-a256-951d6aa277f2 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1266 microversion: 2.1 time: 0.141237 Sep 07 14:48:19.982878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 180/372] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:19 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1266 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:20.114880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:20.115563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:20.131871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:20.132645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:20.134505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:20.135414 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:20.139886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:20.141372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:20.336847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:20.352120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:20.360332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:20.360332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2fed4845-85b7-4cde-a41f-749f96271b85 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.243971 Sep 07 14:48:20.364364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 193/373] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:20 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:20.808178 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:20.809331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:20.819142 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:20.819996 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:20.821689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:20.823286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:20.827293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:20.828375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:20.921742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:20.933357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f9527c90-084a-4835-9b0d-a7c2b5ade97b tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1265 microversion: 2.1 time: 0.135455 Sep 07 14:48:20.937457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 181/374] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:20 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1265 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:21.006257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:21.007578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:21.025930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.029122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.031022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:21.031022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.032677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.033174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:21.113970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:21.123044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8daa8ce7-7102-4f16-bfcf-6a4f0dc5f8e0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1272 microversion: 2.1 time: 0.120905 Sep 07 14:48:21.124306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 194/375] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:21 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:21.390911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:21.391522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:21.405901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.406706 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.407403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:21.408340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.409478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.410264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:21.580431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:21.591753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:21.593272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:21.594540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-507c5644-0492-49c6-bedd-76622a44130c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.207427 Sep 07 14:48:21.595095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 182/376] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:21 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:21.959274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:21.960372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:21.981150 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.981740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.982413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:21.983292 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:21.983757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:21.984209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:22.054380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:22.063242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-00d2d5bb-cb1a-4aa7-84e1-36d5c2c5bb0c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1265 microversion: 2.1 time: 0.107907 Sep 07 14:48:22.076183 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 195/377] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:21 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1265 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:22.153392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:22.155304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:22.164624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:22.165019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:22.165891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:22.166884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:22.167581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:22.168276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:22.326898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:22.337369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8996afb6-c93d-453c-9e61-1ac23f70a6c0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.188869 Sep 07 14:48:22.352262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 183/378] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:22 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:22.622393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:22.623088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:22.632298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:22.632298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:22.632298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:22.632298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:22.632578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:22.632578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:22.766196 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:22.775445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:22.776901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:22.778063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-52124ac3-7c6c-4633-abeb-55aaf06abf8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.159662 Sep 07 14:48:22.778623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 196/379] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:22 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:22.943554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-423910940", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "a8e26959-1568-4534-b648-08fbad1c9109"}], "security_groups": [{"name": "tempest-securitygroup--1477009039"}], "key_name": "tempest-keypair-2097183700", "user_data": "}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:23.045850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] validate_networks() for [('a8e26959-1568-4534-b648-08fbad1c9109', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:48:23.088480 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:23.089371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:23.095919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.096471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.096957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.097678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.098132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.098561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.169591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:23.178266 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-337fd89f-5f15-4211-a75b-9a5a7176e337 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1265 microversion: 2.1 time: 0.093643 Sep 07 14:48:23.180038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 197/380] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:23 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:23.362341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:23.363198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:23.370472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.371149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.371750 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.372771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.373229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.373641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.556217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:48:23.557177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:48:23.557800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:48:23.558385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:48:23.559371 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:48:23.567541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.568014 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.568697 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.570129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.570743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.571329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.592027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:48:23.594569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:23.596547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Getting quotas for user 9d8116d648d64a62af52d9db6a607e13 and project 6869744faba14c0bb69be840cea600f0. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:48:23.603328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-379043c9-cc99-4452-9f60-d3ee8425a548 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.244853 Sep 07 14:48:23.606581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 198/381] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:23 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:23.623754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:48:23.626221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:48:23.793576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-971b5b56-cfd7-48c3-a52b-f97e8506a9e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.854292 Sep 07 14:48:23.794444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 184/382] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:48:22 2022] POST /compute/v2.1/servers => generated 409 bytes in 856 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:48:23.804819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:23.805442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:23.817472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1c2264d9-adfe-4329-ba9e-03f56a1951a1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:23.818405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1c2264d9-adfe-4329-ba9e-03f56a1951a1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:23.825576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.830031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.843799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.849419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:23.849419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:23.849419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:23.879250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1c2264d9-adfe-4329-ba9e-03f56a1951a1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:23.887867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1c2264d9-adfe-4329-ba9e-03f56a1951a1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1245 microversion: 2.1 time: 0.077368 Sep 07 14:48:23.889358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 185/383] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:23 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1245 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:24.074152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:24.085419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:24.087331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:24.088676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d68060f9-d571-4122-9dc3-652b7a2c12db tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.289188 Sep 07 14:48:24.089254 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 199/384] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:23 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:24.202762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:24.203377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:24.211057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:24.211544 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:24.211987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:24.212736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:24.213368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:24.213978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:24.340626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:24.345247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:24.350109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-80357a94-be7e-4281-8724-be455d4e8d29 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1265 microversion: 2.1 time: 0.151214 Sep 07 14:48:24.350725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 186/385] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:24 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:24.626097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:24.630220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:24.637181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:24.637665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:24.638095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:24.641054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:24.641528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:24.643281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:24.922933 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-60993649-96b0-4dcb-b04b-35b7943779ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:24.923551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-60993649-96b0-4dcb-b04b-35b7943779ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:24.990430 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.006697 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-451458c8-62e2-47c7-a81d-993297a99fc0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.384281 Sep 07 14:48:25.012484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 200/386] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:24 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:25.048506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-60993649-96b0-4dcb-b04b-35b7943779ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.062903 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-60993649-96b0-4dcb-b04b-35b7943779ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1245 microversion: 2.1 time: 0.150693 Sep 07 14:48:25.084755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:25.085872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:25.090479 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 187/387] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:24 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1245 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:25.093416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.094533 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.094981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.095688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.096422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.097021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.113853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:25.114796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:25.122719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.129453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.130216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.131164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.132366 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.133201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.359581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'services' on Instance uuid 6e66ab21-f377-46eb-8d32-3cdef7f06e73 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:25.679450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.690118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.692930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.694256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f2d642f-af15-4cfe-abb4-54278147bf65 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.584170 Sep 07 14:48:25.696356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 188/388] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:25 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:25.697152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:25.701826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9", "tag": "aa333897-9aeb-4960-bcaf-836d595de1e7"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:25.711763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.712557 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.713197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.736105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] Creating event network-changed:aa333897-9aeb-4960-bcaf-836d595de1e7 for instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 on hv-cinder-80135 Sep 07 14:48:25.742422 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-b9ddcd7e-527f-453d-99e4-bce997f6bfca req-8b2293e2-8da9-4056-a701-f59fe54fc9f5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044008 Sep 07 14:48:25.745079 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 189/389] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:25.753041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:25.758901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:25.759022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1127a0a8-fd06-4720-95fa-6b3ce276c6c0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73/os-volume_attachments/22c3d58e-1419-4346-bb3c-f185b76268ed" status: 202 len: 0 microversion: 2.1 time: 0.680702 Sep 07 14:48:25.759022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 201/390] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:48:25 2022] DELETE /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73/os-volume_attachments/22c3d58e-1419-4346-bb3c-f185b76268ed => generated 0 bytes in 682 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:48:25.768224 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.768677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.769280 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.770176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:25.770776 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:25.771349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:25.884719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:25.893095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c3175140-96da-4895-84ce-9c7dc62fb969 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1271 microversion: 2.1 time: 0.146681 Sep 07 14:48:25.896277 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 190/391] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:25 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1271 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:26.036688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:26.036688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:26.056514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.057070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.057512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.058198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.058684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.059065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.063997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:26.089952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:26.091943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:26.102627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.103510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.104190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.112034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.112867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.113541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.488286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:26.497839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b1ef5e9b-b158-40f1-a2a0-6d08638fe7ca tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.412076 Sep 07 14:48:26.514012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 191/392] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:26 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:26.585170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:26.596229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7379396f-6340-4317-b0c1-47aa6f20d295 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.564957 Sep 07 14:48:26.608269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 202/393] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:26 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:26.721884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:26.722510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:26.729251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.729747 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.730294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.731016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.731471 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.731891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.897716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:26.907196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:26.909118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:26.911875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d4cc8362-00fe-4d40-adbb-6e6cf1293cb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.193373 Sep 07 14:48:26.920933 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 192/394] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:26 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:26.947291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:26.947908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:26.954004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.954489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.954925 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:26.955611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:26.956096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:26.956537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.094212 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:27.102409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-27fead20-148a-4d0d-86db-cae177d71810 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.189203 Sep 07 14:48:27.102976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 203/395] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:26 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:27.521751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:27.522854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:27.529868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.530581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.531183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.532083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.532723 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.533149 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.602737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:27.613056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-57812bf8-30f6-4291-852f-af5e635af3f3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.093688 Sep 07 14:48:27.614175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 193/396] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:27 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:27.619240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:27.620423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:27.627099 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.627833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.628450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.629284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.629943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.630838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.785079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:27.793482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f620db2c-6481-4b0c-9fe8-e53823346697 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.177891 Sep 07 14:48:27.794559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 204/397] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:27 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:27.946899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:27.947940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:27.956883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.957630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.958372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:27.959593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:27.960296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:27.960921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.107926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:28.118092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:28.119537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:28.120959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f0052c4b-b482-4888-9fbc-be44ea0df1ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.177890 Sep 07 14:48:28.131853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 194/398] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:27 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:28.138187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:28.138187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:28.138187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.138187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.138518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.138518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.138518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.138518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.294113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:28.301894 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5fcbaab6-1c36-4d15-94d3-b5613438100a tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.179867 Sep 07 14:48:28.302513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 205/399] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:28 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:28.636613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:28.637219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:28.643937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.644446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.644931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.645700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.651223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.651223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.723895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:28.731801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-223061b1-7e02-4118-a812-81d08c419808 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.099075 Sep 07 14:48:28.732398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 195/400] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:28 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:28.817896 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:28.818505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:28.824939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.825413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.825845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.826550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:28.826998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:28.827412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:28.936660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=16 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:29.067362 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.076552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f9fdf98c-53bb-4fdb-9ea1-6f58d8871e7c tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.262463 Sep 07 14:48:29.077318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 206/401] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:28 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:29.145886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:29.146497 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:29.152377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.152934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.153369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.154086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.154536 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.154957 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.283977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ca2fd683-c37c-4d42-a2ee-274aac79720c", "tag": "f5edc385-2d4f-4b23-8598-0924b8b0c26c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:29.295365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.295850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.296310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.307847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] Creating event network-changed:f5edc385-2d4f-4b23-8598-0924b8b0c26c for instance ca2fd683-c37c-4d42-a2ee-274aac79720c on hv-cinder-80135 Sep 07 14:48:29.312508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-75f27e51-4123-4aea-80dc-5734fd2b3007 req-da0b6d01-d522-4dbc-b5f4-1a3a699e5ec9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032217 Sep 07 14:48:29.313095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 207/402] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:48:29.324472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:29.325169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:29.331450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.332757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.332757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.333140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.333647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.333962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.334096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.342716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.344300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.345622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b08721b5-1f5d-421b-822f-2ddc58b974bd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.203866 Sep 07 14:48:29.346374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 196/403] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:29 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:29.465929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.473644 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7b992674-76b0-4309-bb9c-28c40f9de9ff tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.153137 Sep 07 14:48:29.474242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 208/404] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:29 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:29.754659 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:29.755276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:29.761834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.762318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.762754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.763444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:29.763898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:29.764414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:29.829619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:29.837801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f5561e1e-8758-4db1-adb6-a127a92c4070 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.087073 Sep 07 14:48:29.838360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 197/405] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:29 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:30.099000 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:30.099479 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:30.101278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:30.105885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.106362 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.106791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.107474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.107925 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.108506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.236172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.243628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ae00a8ba-461b-41a4-ae52-65cea30f0b69 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.148877 Sep 07 14:48:30.244199 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 209/406] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:30 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:30.370616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:30.371251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:30.377214 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.377689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.378117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.378790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.379233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.379650 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.498838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:30.499368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:30.509137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.509687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.510205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.510340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.511429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.512277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.513037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.518825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.520297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.521470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d6933ba1-9457-4d77-957e-c012ca4a0d07 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.154652 Sep 07 14:48:30.522033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 198/407] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:30 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:30.648525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.656328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f61171b7-240d-4541-b463-19143b207f2f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.163385 Sep 07 14:48:30.656892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 210/408] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:30 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:30.860910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:30.861526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:30.869336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.869823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.870262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.870958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:30.871413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:30.871835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:30.935879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:30.943602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-680cb22b-35f4-4252-aa5e-abe310254454 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.086462 Sep 07 14:48:30.944189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 199/409] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:30 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:31.266056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:31.266669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:31.273501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.273982 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.274421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.275116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.275569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.275994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.404878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:31.413330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ae4b0cde-2c65-45e8-8ea4-7854e4931208 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.150454 Sep 07 14:48:31.413892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 211/410] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:31 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:31.547076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:31.547739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:31.554294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.554773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.555203 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.555883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.556362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.556783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.679584 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:31.680242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:31.683432 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:31.686780 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.687344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.687784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.688510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.688983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.689517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.691825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:31.693326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:31.695016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-053a8f42-59bc-43a2-9732-3a85a40d048e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.151918 Sep 07 14:48:31.695575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 200/411] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:31 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:31.821253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:31.829109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eba65c19-5f1e-471f-b22c-0e33af948ffc tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.153492 Sep 07 14:48:31.829674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 212/412] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:31 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:31.965902 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:31.966445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:31.973143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.973631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.974068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:31.974764 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:31.975368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:31.975801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.036957 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:32.044490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-965b434b-e1ec-4b82-ab11-c3fb135726cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.082467 Sep 07 14:48:32.045046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 201/413] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:31 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:32.435661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:32.436312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:32.442375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.442859 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.443294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.444512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.444967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.445392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.569348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:32.576948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-41aad2af-ce21-4df1-b7fc-396a2557b092 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.145079 Sep 07 14:48:32.577512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 213/414] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:32 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:32.720549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:32.721197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:32.727111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.727598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.728036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.728751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.729220 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.729633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.852109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:32.852836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:32.859351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.859897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.860380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.861077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:32.862356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:32.862356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:32.863212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:32.872103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:32.873638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:32.874841 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-98f52d91-1420-4793-850c-3f161a55630c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1740 microversion: 2.20 time: 0.158205 Sep 07 14:48:32.875553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 202/415] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:32 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1740 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:32.996526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:33.004131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-54c4febd-aa61-4335-9c92-b2e7c05cfd54 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.155840 Sep 07 14:48:33.004713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 214/416] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:32 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:33.067104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:33.067652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:33.074032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.074510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.074944 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:33.075624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.076073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.076521 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:33.137213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:33.145150 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-76b78223-c25e-4d40-90b7-c064507826c7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.081853 Sep 07 14:48:33.145737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 203/417] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:33 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:33.602962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:33.604986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:33.615553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.616106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.619620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:33.619620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.619620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.619620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:33.797006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:33.808087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-61036d6f-2cc5-4f55-82a9-1548bed66a91 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.211787 Sep 07 14:48:33.820988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 215/418] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:33 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:33.901311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:33.901873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:33.907467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=4 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:33.909158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.909657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.913398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:33.913398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:33.913398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:33.913398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.029481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:34.030325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:34.038598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.039387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.040189 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.040912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.041372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.041796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.082752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:34.097946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:34.099453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:34.103520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-914c0f2d-57ba-44ab-91a0-acbd0467b3c6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1722 microversion: 2.20 time: 0.204076 Sep 07 14:48:34.104639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 204/419] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:33 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1722 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:34.168307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:34.169291 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:34.176424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.177177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.177907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.179682 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.181796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.182631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.187435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:34.316541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:34.327984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:34.331108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-345d56a4-d8f8-45b2-bbc2-727420a3ba99 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1297 microversion: 2.1 time: 0.165959 Sep 07 14:48:34.331108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 205/420] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:34 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1297 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:34.352417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9a993f86-4d8e-489e-ab6c-c87ff8c8afd2 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.327655 Sep 07 14:48:34.371261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 216/421] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:34 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:34.455738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:34.456861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:34.464158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.464906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.469551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.472033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.472802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.473984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.514756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:48:34.834869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:34.837047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:34.844011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.844830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.845279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.846158 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.846609 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.847040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.921842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fcab093b-ab6d-402e-b3ae-d1b6b275d09c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 204 len: 0 microversion: 2.1 time: 0.470079 Sep 07 14:48:34.927452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 206/422] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:48:34 2022] DELETE /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:48:34.934305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:34.935023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:34.940489 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=6,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:34.945567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.946064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.946561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:34.947297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:34.947886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:34.949120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.056623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=16 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:35.070579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.078946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2c99e69f-720e-46f3-9770-50da3101b6c1 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.250545 Sep 07 14:48:35.079520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 217/423] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:34 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:35.095613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9", "name": "network-vif-plugged", "status": "completed", "tag": "aa333897-9aeb-4960-bcaf-836d595de1e7"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:35.105875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.106591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.107561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.123939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] Creating event network-vif-plugged:aa333897-9aeb-4960-bcaf-836d595de1e7 for instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 on hv-cinder-80135 Sep 07 14:48:35.124993 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-11388935-8f4a-4ae5-b3fe-cac77b3deee7 req-cb873b7e-5e76-480f-917b-f9ef67bbc0ac service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Sep 07 14:48:35.126035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 218/424] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:35.133946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:35.134646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:35.141226 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.142122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.142683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.143407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.144092 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.144988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.208748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.219938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-26fabd8c-47a7-4858-bda7-b0124602d74b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1515 microversion: 2.1 time: 0.290606 Sep 07 14:48:35.222385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 207/425] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:34 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1515 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:35.354764 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:35.355628 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:35.362560 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.363044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.363481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.364270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.364727 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.366795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.368514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.377008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.378437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.379812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6088bd0e-3bfe-4d02-a9ab-f9334f47e17b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1722 microversion: 2.20 time: 0.250924 Sep 07 14:48:35.391740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 219/426] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:35 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:35.399682 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:35.400866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:35.409395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.410057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.411579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.411579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:35.412108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:35.413160 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:35.417846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:35.450362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.459631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c9198403-1784-4109-b68c-3fce002e34cf tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1303 microversion: 2.1 time: 0.108440 Sep 07 14:48:35.460564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 208/427] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:35 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1303 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:35.562140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:35.566025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-37c0898e-96e5-4a37-a206-764a79ef10f5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.171925 Sep 07 14:48:35.566579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 220/428] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:35 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:36.101707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:36.102309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:36.109315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.109786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.110222 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.110923 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.111444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.111859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.240863 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.245445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:36.246065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:36.248685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4c033dfa-3c89-4a2a-b2a4-51028f6dd05b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.150838 Sep 07 14:48:36.249250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 209/429] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:36 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:36.253040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.253528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.253964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.254656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.255115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.255541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.389839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.398529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-234b520d-54b1-41ae-a66f-035bf29b7248 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1515 microversion: 2.1 time: 0.156873 Sep 07 14:48:36.399290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 221/430] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:36 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1515 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:36.404364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:36.404998 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:36.410801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.415433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.415433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.415433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.415433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.415777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.482891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:36.483883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:36.489763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.490265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.491218 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.491891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.492365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.495687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.570684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.579359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.580832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.583305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a53894c2-4bef-40ae-8bdb-5bccdf8f0f9d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1722 microversion: 2.20 time: 0.181538 Sep 07 14:48:36.583305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 210/431] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:36 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:36.592366 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:36.593165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:36.599248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.599943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.600571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.601270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:36.601722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:36.602145 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:36.639182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.647330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f7ae36ac-84c5-4d7e-a2fe-a8d6168313ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.168273 Sep 07 14:48:36.647944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 222/432] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:36 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:36.736236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:36.747932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6e59424a-75f6-4961-93c7-b56f8a126a25 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.160639 Sep 07 14:48:36.747932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 211/433] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:36 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:37.140762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "name": "network-vif-unplugged", "status": "completed", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:37.150915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.151393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.151823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.163317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] Creating event network-vif-unplugged:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:48:37.168063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-744d8ad5-b1d8-4699-ac1d-829b4b91adf5 req-7d2358ec-fcda-4d0c-8585-d0984a64f6d4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031024 Sep 07 14:48:37.168656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 223/434] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:37.272917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:37.273774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:37.279908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.280428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.280865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.281565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.282016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.282442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.420013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.422591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:37.431082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:37.431416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2d52a74f-c546-45fb-95a5-67f015676fe6 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.159637 Sep 07 14:48:37.431416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 212/435] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:37 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:37.431637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.431637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.431637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.431637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.432056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.432538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.565036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.573511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-26639011-c55a-4025-833e-f3da9c7c5ae4 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1515 microversion: 2.1 time: 0.155668 Sep 07 14:48:37.574080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 224/436] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:37 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:37.607721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:37.608377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:37.614233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.614719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.615156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.615859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.616357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.616783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.669872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:37.670397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:37.676643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.677463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.677810 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.678508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.678964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.679396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.784550 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.793398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.794449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.795610 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b5ab7ec4-c5ac-4aec-84ec-81b8182ef497 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1722 microversion: 2.20 time: 0.191961 Sep 07 14:48:37.796187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 213/437] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:37 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1722 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:37.800761 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:37.801376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:37.807930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.808980 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.809122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.809789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:37.810248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:37.810696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:37.844474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.852211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1c929b44-ab38-4264-92b6-3893402833ae tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.186226 Sep 07 14:48:37.852776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 225/438] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:37 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:37.983158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:37.991254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-50f6c17c-cbc4-4f58-9e30-ec84f70c593c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.193592 Sep 07 14:48:37.991804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 214/439] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:37 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:38.450825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:38.451495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:38.457748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.458259 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.458679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.459352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.459794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.460235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.589426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:38.598349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:38.598808 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6f2f7ebb-63ac-4440-abc6-5b739c161872 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.150542 Sep 07 14:48:38.598903 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:38.598996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 226/440] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:38 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:38.604238 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.604736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.605158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.605853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.606304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.606724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.737821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:38.746125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e57fd19f-1708-4a28-a8aa-dde1d14c3714 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1515 microversion: 2.1 time: 0.152731 Sep 07 14:48:38.746741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 215/441] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:38 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:38.820560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:38.821168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:38.827163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.827641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.828077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.828860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.829308 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.829724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.874976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:38.875591 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:38.881597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.882083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.882540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:38.883221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:38.883672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:38.884102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.015165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:39.024504 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:39.025931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:39.027078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-26878227-d868-4234-a0c6-77761b7058eb tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1722 microversion: 2.20 time: 0.210440 Sep 07 14:48:39.027638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 227/442] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:38 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:39.031985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:39.032615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:39.038343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.038826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.039253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.039943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.040428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.040877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.046869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:39.055522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-651587d4-c020-44f6-9658-a66e66943510 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.184438 Sep 07 14:48:39.056106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 216/443] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:38 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:39.238356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:39.247977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-210b7fca-bf9e-4dd4-88c9-2df1ededd1c6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.219207 Sep 07 14:48:39.248599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 228/444] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:39 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:39.622317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:39.623074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:39.629254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.629859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.630396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.632207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.634285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.635190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.770125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:39.770955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:39.778110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.778599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.779065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:39.779723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:39.780194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:39.780818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.148839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.156484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-39904744-74d7-46eb-838c-5fa1a6d0d897 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1473 microversion: 2.1 time: 0.391033 Sep 07 14:48:40.157049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 229/445] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:39 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1473 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:40.164400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:40.165321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:40.175310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.176058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.176693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.177324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.178145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.178869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.179457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.183554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-123e6d48-09be-4682-a31e-ad83579bf44b tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1314 microversion: 2.1 time: 0.565681 Sep 07 14:48:40.184350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 217/446] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:39 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1314 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:40.188929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:40.189529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:40.195815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.196331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.196771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.197466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.197915 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.198332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.460503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.465346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.468874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aad43867-00f3-4268-af18-6ca85dd1738d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.283370 Sep 07 14:48:40.469656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 218/447] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:40 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:40.476116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e66ab21-f377-46eb-8d32-3cdef7f06e73", "name": "network-vif-deleted", "tag": "34ff295b-1c6a-439c-831f-6fa1379064a1"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:40.477022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.478712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.479998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4bad1af5-8889-42ee-b172-665e0a32ebe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1725 microversion: 2.20 time: 0.322021 Sep 07 14:48:40.480725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 230/448] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:40 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1725 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:40.486749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.487318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.487822 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.492465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:40.493784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:40.500277 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] Creating event network-vif-deleted:34ff295b-1c6a-439c-831f-6fa1379064a1 for instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 on hv-cinder-80135 Sep 07 14:48:40.501589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.502259 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.502709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.503560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.507648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-ac680850-5f71-4a00-8282-6e1d6dd06710 req-df31880d-fc9f-45c0-ace0-1f24c4915592 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036443 Sep 07 14:48:40.508637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 219/449] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:40.516130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "252e1fc0-d302-4664-b8f6-ae2aec1ae32a"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:40.518265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:40.522477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.522942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.526428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.527165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.528083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.529185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.529851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.530491 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.619669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:40.695149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:40.703659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-94995754-15d2-401b-8f39-ea126c0ae249 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.221767 Sep 07 14:48:40.704261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 231/450] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:40 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:40.708939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:40.721036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:40.721543 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:40.721976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:40.733579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] Creating event network-changed:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:48:40.738370 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-417b045d-6165-423d-895d-5888caf5c951 req-c62d2998-0c1a-44d1-91fa-cc7768c56263 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033023 Sep 07 14:48:40.738984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 232/451] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:41.180780 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:41.182033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:41.190733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.191230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.191667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.192509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.192964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.193392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.229198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.229671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.230107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.230554 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'fault' on Instance uuid 6e66ab21-f377-46eb-8d32-3cdef7f06e73 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:41.274215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:41.282127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1f59a56b-3b52-4376-931a-cc68606ea4a0 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1309 microversion: 2.1 time: 0.105545 Sep 07 14:48:41.282643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 233/452] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:41 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:41.287475 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:41.288086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:41.293779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.294260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.294685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.295391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.295845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.296295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.436230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:41.444790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-63d4975f-3ad7-4a02-821f-431e4ec70d96 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1498 microversion: 2.1 time: 0.161124 Sep 07 14:48:41.445473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 234/453] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:41 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1498 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:41.492940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:41.493548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:41.509757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.509757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.509757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.509757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.510142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.510142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.672284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-18f07fd2-6eb7-4338-bf49-0a3a37573658 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.161756 Sep 07 14:48:41.674005 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 220/454] 10.222.0.57 () {62 vars in 1364 bytes} [Wed Sep 7 14:48:40 2022] POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments => generated 188 bytes in 1164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:48:41.745127 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:41.745921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:41.758344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.759315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.759953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.760958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.761676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.762621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.791478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:41.803929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eedea5d3-d58f-4dc0-bb9a-566a25089ea7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.314691 Sep 07 14:48:41.822131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 235/455] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:41 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:41.848420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:41.849284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:41.855872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.856476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.856979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.857850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:41.858378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:41.858877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:41.921595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127536) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 14:48:42.028164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:42.038811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d886e822-6dd4-4b5d-9278-9a0be7e29182 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.315499 Sep 07 14:48:42.039981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 221/456] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:41 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:42.156293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:42.252120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7944f138-1f97-41d8-8cbd-b7efb670995b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/action" status: 202 len: 0 microversion: 2.20 time: 0.407624 Sep 07 14:48:42.253140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 236/457] 10.222.0.57 () {62 vars in 1319 bytes} [Wed Sep 7 14:48:41 2022] POST /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:48:42.263117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:42.263738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:42.283321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.283321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.283321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.284638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.294097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.303799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.307199 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:42.307870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:42.315636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.316127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.316580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.317515 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.317964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.320340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.381204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.381954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.382578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.383166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'fault' on Instance uuid 6e66ab21-f377-46eb-8d32-3cdef7f06e73 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:42.494096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:42.506871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7360c5fc-2d1d-4017-adcf-3991e3c64f7b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1309 microversion: 2.1 time: 0.204738 Sep 07 14:48:42.512364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 237/458] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:42 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1309 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:42.521981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:42.522498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:42.534581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.535060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.540722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.540722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.540722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.540722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.573174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:48:42.644965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:42.654094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:42.655736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:42.657303 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d1c33688-5c29-48cb-a910-d1c9556cbe15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1751 microversion: 2.20 time: 0.398193 Sep 07 14:48:42.658311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 222/459] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:42 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1751 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:42.832654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:42.833692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:42.857546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.858041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.864523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.865931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.866418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.873801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.956704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c3639d63-5a3a-40f5-bcd1-3986216dd0f0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "DELETE /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 204 len: 0 microversion: 2.1 time: 0.446745 Sep 07 14:48:42.957299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 238/460] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:48:42 2022] DELETE /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 0 bytes in 449 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:48:42.966012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:42.966916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:42.977960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.978459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.978897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:42.979597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:42.980091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:42.980965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.105965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.130152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1e794353-f70b-4e77-9dc5-292ccb9049ed tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.303089 Sep 07 14:48:43.131016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 223/461] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:42 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:43.149282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:43.149938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:43.160809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.161398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.164350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.164350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.164350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.164350 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.166077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.176044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-86d1f65d-0287-41ac-a0ef-db7c3bd4e726 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1504 microversion: 2.1 time: 0.214135 Sep 07 14:48:43.177092 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 239/462] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:42 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1504 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:43.185686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fd683-c37c-4d42-a2ee-274aac79720c", "name": "network-vif-plugged", "status": "completed", "tag": "f5edc385-2d4f-4b23-8598-0924b8b0c26c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:43.195957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.196460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.196884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.209639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] Creating event network-vif-plugged:f5edc385-2d4f-4b23-8598-0924b8b0c26c for instance ca2fd683-c37c-4d42-a2ee-274aac79720c on hv-cinder-80135 Sep 07 14:48:43.214825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-ef75493d-4651-4eeb-951a-ee8f12eb067e req-8626f56a-7914-4929-893f-1d6c09573d39 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033291 Sep 07 14:48:43.215433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 240/463] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:43.313693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.324782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c70630ef-5c83-4a5a-b728-3cdf9ce9e3ef tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.191068 Sep 07 14:48:43.325378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 224/464] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:43 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:43.537703 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:43.538407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:43.548881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.549380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.549884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.550588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.551044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.551468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.590506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.590996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.591431 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.591881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'fault' on Instance uuid 6e66ab21-f377-46eb-8d32-3cdef7f06e73 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:43.636688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.645410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9e3715d9-f974-44fb-9591-281e442362a8 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1309 microversion: 2.1 time: 0.111806 Sep 07 14:48:43.656573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 241/465] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:43 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1309 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:43.682469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:43.683162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:43.689210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.689692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.690125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.690819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:43.691274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:43.691702 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:43.829889 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.839620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.841102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:43.842287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c68d54d9-6f1a-4b32-b03e-a8019c24dc58 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1751 microversion: 2.20 time: 0.163714 Sep 07 14:48:43.842876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 225/466] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:43 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1751 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:44.153847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:44.154508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:44.160478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.160961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.161396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.162662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.163135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.163587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.199119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:44.199770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:44.206357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.206852 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.207295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.207994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.208483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.209401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.354192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:44.364668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-98c729fd-31f8-4dc6-87ba-ce3d1d73223e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.214597 Sep 07 14:48:44.365252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 242/467] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:44 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:44.370018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:44.370626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:44.376603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.377024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.377132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:44.377459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.378237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.378715 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.379301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.387176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c8c26bd0-8a3c-4f4b-ba0f-c115a787612e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1504 microversion: 2.1 time: 0.191805 Sep 07 14:48:44.388182 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 226/468] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:44 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1504 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:44.510717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:44.518547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-268286ea-6ebd-4967-9271-100a56ee124f tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.152113 Sep 07 14:48:44.519101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 243/469] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:44 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:44.667765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:44.668407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:44.674444 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.674936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.675371 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.676061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.676543 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.676971 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.710111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.710592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.711028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.711476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'fault' on Instance uuid 6e66ab21-f377-46eb-8d32-3cdef7f06e73 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:44.751744 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:44.760300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-498e64d7-7c37-4c4b-969d-4cf4ab75a0ea tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 200 len: 1309 microversion: 2.1 time: 0.096241 Sep 07 14:48:44.760796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 227/470] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:44 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 1309 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:44.868123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:44.868764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:44.874748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.875230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.875665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:44.876384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:44.876839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:44.877260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.006826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.015654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.017331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.018500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9772042d-f6a8-494c-b059-af12b331a2e5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1751 microversion: 2.20 time: 0.154349 Sep 07 14:48:45.019053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 244/471] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:44 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1751 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:45.387477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:45.388275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:45.395739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.396272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.397263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.398171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.398670 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.399098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.411037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:45.411646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:45.418277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.418950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.419535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.420610 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.421207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.421783 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.603787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.612843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-566d05ab-0040-41c1-a836-cdf47f4158dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.229020 Sep 07 14:48:45.613418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 228/472] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:45 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:45.619299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:45.619442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.620233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:45.628695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7d27669a-15ac-4910-8054-8a4c7cd58048 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1504 microversion: 2.1 time: 0.221346 Sep 07 14:48:45.629128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.629627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.630103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.635013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.635152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 245/473] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:45 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1504 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:45.635281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.635281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.768928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:45.776893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4e69cf7c-2149-4729-a76e-852a7b7e0b32 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.162337 Sep 07 14:48:45.788522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 229/474] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:45 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:45.793814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:45.794424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: 6e66ab21-f377-46eb-8d32-3cdef7f06e73] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:45.800616 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.801101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.801536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.802227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:45.803286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:45.803761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:45.818575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] HTTP exception thrown: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Request method failure captured: Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 HTTP/1.1 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK7fd7goJdogJL_jE_h9W_8lHVQyTmA2wWbH1eWCc5M2C2a3k9MBg6JXI6f-HNv1qnKdEyw01okdp6Ej76NuQdbbk9ZMI6m0s9wRHo93p9FodTmWEc4_CWy2w172hqK5r406zhUcl_IzwAlRxz2521KT9e3o_payHBTNaq4-9mOSgEE Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2ed99ce2509c4163b314baa4cf3e5ae5 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:48:45.820233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2ed99ce2509c4163b314baa4cf3e5ae5 Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesSnapshotTestJSON-350011363-project Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: cfd87fa14f924cb897959950c79739ef Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesSnapshotTestJSON-350011363-project Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. Sep 07 14:48:45.821852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '6e66ab21-f377-46eb-8d32-3cdef7f06e73'} Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:48:45.822641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. Sep 07 14:48:45.823830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:45.831767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Returning 404 to user: Instance 6e66ab21-f377-46eb-8d32-3cdef7f06e73 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:48:45.831767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-491d9ff6-9413-4e24-ac2e-44ad04ed4a3d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73" status: 404 len: 111 microversion: 2.1 time: 0.032094 Sep 07 14:48:45.831767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 246/475] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:45 2022] GET /compute/v2.1/servers/6e66ab21-f377-46eb-8d32-3cdef7f06e73 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:46.010247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9", "name": "network-vif-deleted", "tag": "aa333897-9aeb-4960-bcaf-836d595de1e7"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:46.019911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.020437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.020867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.031977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] Creating event network-vif-deleted:aa333897-9aeb-4960-bcaf-836d595de1e7 for instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 on hv-cinder-80135 Sep 07 14:48:46.036905 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-46fbfc0f-d64b-49fb-ba6b-7fe49b703ad4 req-e26f8779-c4c4-46bb-83fc-2c2fb7fd0852 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030505 Sep 07 14:48:46.038972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 230/476] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:46.044230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:46.044943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:46.050962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.051442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.051876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.053652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.054116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.054544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.182521 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.191243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.192721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.194544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-edd5556c-3063-4a3f-b382-cc663bbd710a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.153808 Sep 07 14:48:46.194758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 247/477] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:46 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:46.637676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:46.683099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:46.683099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.683099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.683099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.683504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.683504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.683504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.683754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:46.683754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:46.683754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.683754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.684109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.684109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.684109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.684109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.754127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.762295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24a70eed-bf5d-493f-b3c6-346b21e45ba5 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1462 microversion: 2.1 time: 0.109112 Sep 07 14:48:46.762852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 248/478] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:46 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1462 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:46.800686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:46.801277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:46.807187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.807670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.808129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.808846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:46.809298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:46.809721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:46.816462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.824441 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1447a0be-dadd-4bdc-83de-9216ca17a8a3 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.191919 Sep 07 14:48:46.825000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 231/479] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:46 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:46.937639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:46.946104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d1ccf73d-502e-4554-9dbb-483355fd4620 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.149220 Sep 07 14:48:46.946667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 249/480] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:46 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:47.224260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:47.224867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:47.230760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.231244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.231682 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.232408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.232865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.233292 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.364860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:47.374070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:47.375490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:47.376669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ff97ab8d-6864-41f0-941c-eccfefa580ff tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.156255 Sep 07 14:48:47.377226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 232/481] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:47 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:47.786526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:47.787747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:47.791289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:47.794640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.795120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.795553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.796271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.796731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.797225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.846859 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:47.847499 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:47.854747 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.855259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.855868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.856595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.857044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.857464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.860362 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:47.868156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-96818236-fc74-476c-b18b-e0d985a92452 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1462 microversion: 2.1 time: 0.085451 Sep 07 14:48:47.868733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 250/482] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:47 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1462 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:47.974100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:47.975368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:47.981525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.982016 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.982450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.983141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:47.983589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:47.984007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:47.985731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:47.993460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a6c92253-d41c-42ba-ab88-848b3027b659 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.150343 Sep 07 14:48:47.993998 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 233/483] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:47 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:48.122143 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:48.130002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6a3d0d0e-7e10-4b96-8c56-fdef8045cee0 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.165961 Sep 07 14:48:48.130573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 251/484] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:47 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:48.405688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:48.406011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:48.412099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:48.415414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:48.415414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:48.415414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:48.415414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:48.416045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:48.569664 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:48.580344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:48.580344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:48.581738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3a5333e6-ca19-4b9f-a6f0-eba2bebf39f0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.180455 Sep 07 14:48:48.582309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 234/485] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:48 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:48.890733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:48.895001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:48.898121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:48.898600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:48.899033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:48.899718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:48.900193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:48.900615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:48.919865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:48.963682 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:48.976100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b09d4456-5fc7-406e-b0a8-c4b98cddc98e tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1299 microversion: 2.1 time: 0.084639 Sep 07 14:48:48.976100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 252/486] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:48 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1299 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:49.016347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:49.017295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:49.023767 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.024279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.024710 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.025387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.025832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.026249 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.030385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:49.153468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:49.154088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:49.156567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:49.161006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.161492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.161969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.163206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.163664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.164123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.164898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2717785f-fa1e-4247-97e6-829ded38d40c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.152443 Sep 07 14:48:49.165454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 235/487] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:49 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:49.291632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:49.299287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8c7bcae0-fb1f-4298-8f4d-88748cf9d522 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.149672 Sep 07 14:48:49.299850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 253/488] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:49 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:49.606731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:49.607347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:49.613440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.613929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.614360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.615045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:49.615496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:49.615918 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:49.745367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:49.754076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:49.756093 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:49.757282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2383b98b-7ee7-46f2-8e9a-799006d242cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.154455 Sep 07 14:48:49.757954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 236/489] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:49 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:49.995214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:49.995815 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:50.002195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.002665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.003086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.003757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.004225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.004643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.065294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.073447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ed50fc30-136b-4ae0-b8e6-8c3db7e4465f tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1299 microversion: 2.1 time: 0.082072 Sep 07 14:48:50.073999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 254/490] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:49 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1299 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:50.187754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:50.188448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:50.195443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.195921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.196390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.197081 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.197535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.197960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.321779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:50.322802 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:50.324631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.328782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.329264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.329695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.330389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.330841 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.331264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.332458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5dbccfce-8d76-4da2-9768-a3b2ab0f5a4d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.148521 Sep 07 14:48:50.333027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 237/491] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:50 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:50.461614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.469207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0db99247-c0f4-4405-9c86-9cba56e246fb tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.151326 Sep 07 14:48:50.469776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 255/492] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:50 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:50.783285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:50.783898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:50.789981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.790465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.790899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.791660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:50.792113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:50.792565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:50.919025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.927958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.929439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:50.930626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9f987e82-c741-440b-8719-9c5bb06e5a14 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.151468 Sep 07 14:48:50.931183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 238/493] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:50 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:51.095908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:51.096548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:51.103426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.103918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.104386 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.105076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.105544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.105960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.165909 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:51.173486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-04ccf870-9745-4ea2-8c2d-ef5e5830ca68 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1299 microversion: 2.1 time: 0.081463 Sep 07 14:48:51.174045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 256/494] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:51 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1299 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:51.355819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:51.356382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:51.362637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.363143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.363578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.364296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.364756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.365833 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.492671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:51.493301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:51.504502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.504502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.504502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.504912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.505337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.505799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.569681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:51.578737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4d1b7fee-9933-41bf-9267-c8cf9c4e1c76 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.226730 Sep 07 14:48:51.579654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 239/495] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:51 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:51.669321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:51.677496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c7e1577-cfba-4c38-8fc0-ad95eede6472 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.189377 Sep 07 14:48:51.678073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 257/496] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:51 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:51.957025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:51.957475 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:51.963463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.963951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.964888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:51.965197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:51.965693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:51.966144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.103724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.112514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.113941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.115725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-90d76acf-b1f0-48eb-b33f-dc0132b0105d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.162275 Sep 07 14:48:52.116615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 240/497] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:51 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:52.196977 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:52.197685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:52.204125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.204628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.205052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.205791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.206198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.210047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.238450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.238928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.239355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.239787 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:52.280765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.289282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8024e9c4-ed19-4af1-a39b-7c719f572cd0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1304 microversion: 2.1 time: 0.096335 Sep 07 14:48:52.289887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 258/498] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:52 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1304 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:52.606671 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:52.607983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:52.614417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.614909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.615353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.616105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.616597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.617022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.704192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:52.704821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:52.711817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.712591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.713036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.713801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:52.714208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:52.714666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:52.765052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.775959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f43b09fc-d7a9-4eeb-811c-c79225377726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.172841 Sep 07 14:48:52.776941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 241/499] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:52 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:52.855987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:52.863898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c495ba24-b67b-4c57-b675-9634e508d633 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1313 microversion: 2.1 time: 0.167627 Sep 07 14:48:52.864484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 259/500] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:52 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:53.140619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:53.141232 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:53.149819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.150341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.150787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.151493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.151950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.152413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.288095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:53.297046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:53.298486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:53.299695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-74b0a4fe-5cb8-473d-a9c0-821c540c7d89 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1753 microversion: 2.20 time: 0.162834 Sep 07 14:48:53.300267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 242/501] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:53 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1753 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:53.312638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:53.313255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:53.319775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.320290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.320731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.321418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.321872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.322295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.354729 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.355215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.355648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.356088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lazy-loading 'fault' on Instance uuid 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:48:53.397732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0fb67f4c58934a568fedf74dc9d45c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2497a9df3f354a5789cc9f7735e39828', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:53.405702 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6ad96ccb-4a0a-4013-9033-797d70ccc4b0 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 200 len: 1304 microversion: 2.1 time: 0.097121 Sep 07 14:48:53.406268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 260/502] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:53 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 1304 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:53.651831 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "name": "network-vif-plugged", "status": "completed", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:53.661619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.662686 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.663117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.673940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] Creating event network-vif-plugged:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:48:53.678834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-dddfb220-e974-4c38-9d89-3d4990ed1f8e req-38ece16b-c9f6-4391-b876-cc908bf71706 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030622 Sep 07 14:48:53.679406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 243/503] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:48:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:53.799170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:53.799927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:53.806469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.807134 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.807566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.808282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.808753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.809171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.890465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:53.891731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:53.909837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.910510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.911121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:53.912908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:53.913527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:53.914105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.011677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.023282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1c0f6be4-e640-462b-b05a-e0ea7e3d5771 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.227896 Sep 07 14:48:54.024299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 261/504] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:53 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:54.089467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.100218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bb316a04-42d5-4cd2-8409-4d7e94faf58c tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1462 microversion: 2.1 time: 0.216737 Sep 07 14:48:54.112306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 244/505] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:53 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1462 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:54.147862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:54.148379 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:54.154781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.155265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.155684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.156628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.157073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.157494 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.187946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:48:54.329693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:54.329693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:54.332842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.333316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.333756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.334488 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.334943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.335377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.482495 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.491524 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.492856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-da7fe773-6d82-446b-84d3-e65d48467c52 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 204 len: 0 microversion: 2.1 time: 0.348428 Sep 07 14:48:54.493320 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.495055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 262/506] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:48:54 2022] DELETE /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 0 bytes in 350 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:48:54.495161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9aab4ff5-b91b-4c34-b399-153c73dbdf83 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.172683 Sep 07 14:48:54.501774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:54.502489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] [instance: 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:54.508550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.509438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.509623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 245/507] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:54 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:54.510191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.511044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.511656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.512252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.519276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:54.523711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:54.526651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.527139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.527572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.528294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:54.528943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:54.529800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:54.530059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] HTTP exception thrown: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Request method failure captured: Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 HTTP/1.1 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK8AiQPswZGmyxknLolh7e96baviyBuRxv1Gk-H2z8cmqeuezZOSeaAuS7fwmPWjLE2gz2CFmFrBcDNHSt4wto2V4Pt7M_lyQVy5aOMQ94HVEsgStNrPl9rKSz_KFksGU6I5xvJBDxsqL7cDCzlBmtQKgQfmKwmI5amE4dAox5J0Qpo Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2497a9df3f354a5789cc9f7735e39828 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:48:54.531939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2497a9df3f354a5789cc9f7735e39828"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2497a9df3f354a5789cc9f7735e39828 Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesActionsTest-1168063084 Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesActionsTest-1168063084-project Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 0fb67f4c58934a568fedf74dc9d45c8d Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesActionsTest-1168063084-project Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. Sep 07 14:48:54.533327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9'} Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:48:54.534058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. Sep 07 14:48:54.535338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:54.536617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] Returning 404 to user: Instance 06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:48:54.536617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b97d0d27-55cc-4a0f-ae4d-9ac5d43cc1e8 tempest-VolumesActionsTest-1168063084 tempest-VolumesActionsTest-1168063084-project] 10.222.0.57 "GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9" status: 404 len: 111 microversion: 2.1 time: 0.038645 Sep 07 14:48:54.536617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 263/508] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:54 2022] GET /compute/v2.1/servers/06c8dbc7-f41f-4f17-8f3a-5b6ded1b1eb9 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:48:54.679793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:54.688130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6ea365c8-78c4-454b-a7ff-32bbf3fb04d3 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.177402 Sep 07 14:48:54.689003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 246/509] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:54 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:55.046502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:55.047142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:55.058529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.058529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.058529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.058529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.058842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.058842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.198844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:55.206927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8597484c-3400-4f94-be4b-5264649afa67 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.164608 Sep 07 14:48:55.207919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 264/510] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:55 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:55.527972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:55.528802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:55.535347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.538006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.538006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.538006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.538006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.538731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.668040 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:55.676637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:55.678103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:55.679306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ba86083b-58f9-4990-a773-e1acfac879ce tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.159127 Sep 07 14:48:55.679852 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 247/511] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:55 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:55.712378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:55.712997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:55.719720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.720327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.720764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.721465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.721920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.722339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.857128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:55.865248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a542527e-3fe2-4b94-b743-64ef9bf99c3e tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.157334 Sep 07 14:48:55.871886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 265/512] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:55 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:55.921052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:55.921574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:55.927921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.928430 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.928860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.929534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.929977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.930394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.953443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-20076d96-38f3-4409-932d-bc55b2c36806 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/ips" status: 200 len: 148 microversion: 2.1 time: 0.037501 Sep 07 14:48:55.953979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 248/513] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:48:55 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/ips => generated 148 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:48:55.965366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62921461-3282-4f4f-bc1e-7deae1fba834"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:55.967739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:55.974637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.975122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.975582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:55.976304 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:55.976756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:55.977176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.054612 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: POST /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/os-volume_attachments HTTP/1.1 Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 74 Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:48:56.056280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {"volumeAttachment": {"volumeId": "62921461-3282-4f4f-bc1e-7deae1fba834"}} Sep 07 14:48:56.057877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'server_id': '6cbc686c-776f-41cd-96ee-331395bc2204', 'body': {'volumeAttachment': {'volumeId': '62921461-3282-4f4f-bc1e-7deae1fba834'}}} Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:56.058758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:48:56.060105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 400 to user: Invalid volume: volume 62921461-3282-4f4f-bc1e-7deae1fba834 is already attached to instances: be5f6be2-5405-4fec-9c2c-584b8e270d1a {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36c28974-5f17-4d20-83da-e0de8db1156f tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096294 Sep 07 14:48:56.061505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 266/514] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:48:55 2022] POST /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:48:56.066473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:56.066968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:56.073437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.073912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.074338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.075010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.075458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.075872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.100163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:48:56.230624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:56.231148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:56.237120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.237595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.238024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.238716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.239164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.239584 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.260035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:56.338287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aa428055-ffb7-44b9-a7cf-4b401df123e4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 204 len: 0 microversion: 2.1 time: 0.275200 Sep 07 14:48:56.339163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 249/515] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:48:56 2022] DELETE /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:48:56.348622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:56.349925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:56.356139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.356801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.357232 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.358040 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.358496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.358996 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.369182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:56.376643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-91ded30f-ed76-4aef-add1-8051a0ea3579 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.150018 Sep 07 14:48:56.377209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 267/516] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:56 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:56.496133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:56.503989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a73811e0-e5b5-42c4-8f3f-b33be0fd83e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.159539 Sep 07 14:48:56.509117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 250/517] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:56 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:56.708049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:56.709202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:56.715213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.715796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.716126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.718561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.718561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.718561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.847350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:56.856280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:56.857694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:56.858832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fe29669e-b449-4df0-b1c3-19266f1240bf tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.155017 Sep 07 14:48:56.859472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 268/518] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:56 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:56.887531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:56.888434 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:56.895291 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.895770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.896762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.897452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:56.897906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:56.898335 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:56.902322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:57.032874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:57.040496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-651068ac-39f5-44ec-9357-5f1c4d143aa6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.157411 Sep 07 14:48:57.041050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 251/519] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:56 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:57.399732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:57.400378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:57.406448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.406933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.407403 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:57.408089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.408575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.408999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:57.527319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:57.527923 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:57.533743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.534219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.534647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:57.535329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.535775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.536215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:57.538088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:57.545758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3b5fc6e4-e7e4-4779-a21d-bf6a55c7035e tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.150308 Sep 07 14:48:57.546316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 269/520] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:57 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:57.663127 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:57.670746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c54d999d-900a-43ee-a3fa-7817add28c54 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.147192 Sep 07 14:48:57.672826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 252/521] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:57 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:57.884472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:57.885114 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:57.891480 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.892262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.892700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:57.893390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:57.893846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:57.894269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.025936 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:58.034390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:58.035802 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:58.036975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b21fdfbd-37e5-4aee-9b5d-42138c908469 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.156941 Sep 07 14:48:58.037527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 270/522] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:57 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:48:58.062644 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:58.064970 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:58.065583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:48:58.070863 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.071340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.079153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.079153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.079153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.079153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.199324 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:58.206989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b869ad66-56eb-4959-99bb-cea147d5bff6 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.148158 Sep 07 14:48:58.207545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 253/523] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:58 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:58.564931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1596745684", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "networks": [{"uuid": "570251e2-010a-4a4b-9d3d-b0f242e0f043"}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:48:58.568110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:58.568748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:58.575220 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.575220 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.575538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.576254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.576742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.577116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.618803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] validate_networks() for [('570251e2-010a-4a4b-9d3d-b0f242e0f043', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:48:58.785263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:58.793705 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ae5c790f-b971-4668-ad0c-1c0fa21cd531 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.229322 Sep 07 14:48:58.794276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 254/524] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:58 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:48:58.798797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:58.799406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:58.805908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.806394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.806833 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:58.807532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:58.807967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:58.808425 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.012279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.020116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-21850b49-5f71-47ee-9705-6ddd0b578680 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.224897 Sep 07 14:48:59.020701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 255/525] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:58 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:59.061649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:59.062304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:59.068672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.069272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.069560 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.070308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.070683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.071097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.105280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:48:59.105749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:48:59.106173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:48:59.106585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:48:59.106999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:48:59.116115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.116636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.117068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.117793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.118245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.118662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.136057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Getting quotas for project 2ed99ce2509c4163b314baa4cf3e5ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:48:59.140966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Getting quotas for user cfd87fa14f924cb897959950c79739ef and project 2ed99ce2509c4163b314baa4cf3e5ae5. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:48:59.153036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:48:59.155337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:48:59.279269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4ad93990-db69-4adf-a9c1-45359f6b918a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.718139 Sep 07 14:48:59.280163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 271/526] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:48:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 720 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:48:59.284672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:59.285279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:59.291967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.292474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.292983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.293691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.294147 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.294574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.496573 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.506016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.507532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.508839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7791f0e7-85f0-444d-ad5a-2571aac73a75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.451002 Sep 07 14:48:59.509469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 256/527] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:48:59 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:48:59.513934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fc0fdf7a-75b0-42af-ab0c-90f2e97e882a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:59.514537 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fc0fdf7a-75b0-42af-ab0c-90f2e97e882a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:59.553338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.561450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-52ddb708-28c2-4f4b-aca4-6473d0ac28e8 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.280503 Sep 07 14:48:59.562217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 272/528] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:59 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:59.569467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fc0fdf7a-75b0-42af-ab0c-90f2e97e882a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.576877 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fc0fdf7a-75b0-42af-ab0c-90f2e97e882a tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1219 microversion: 2.1 time: 0.066277 Sep 07 14:48:59.577452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 257/529] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:59 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1219 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:48:59.816296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:48:59.817034 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:48:59.823700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.824203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.824646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.825333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:48:59.825788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:48:59.826207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:48:59.954876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:48:59.962626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-16e395ae-7a4f-43c5-bb88-ad8fdacf6732 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.150448 Sep 07 14:48:59.963195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 273/530] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:48:59 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:00.043470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:00.044080 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:00.049965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.050439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.050866 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.051538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.051982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.053061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.178329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.185913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bf4f31e4-e921-4ec2-80b9-8b05d9ea4e36 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.146303 Sep 07 14:49:00.186463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 258/531] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:00 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:00.534839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:00.535356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:00.542071 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.542555 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.542990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.543681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.544132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.544579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.585184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:00.585790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:00.591646 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.592118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.592581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.593265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.593711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.594132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.717788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.727451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.729708 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.730884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2b9f112e-a84c-4808-866b-6286dfacd4fd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.199989 Sep 07 14:49:00.741041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 274/532] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:00 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:00.748441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:00.749124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:00.756132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.756660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.757013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.757207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.757767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.758270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.758649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.768786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f4a78971-bc15-48ad-bd05-2735327be7d5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.187806 Sep 07 14:49:00.779179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 259/533] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:00 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:49:00.824231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:00.831884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-74e2cb16-a484-4f7f-adc0-8cd5a5baf29f tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1223 microversion: 2.1 time: 0.099466 Sep 07 14:49:00.832475 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 275/534] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:00 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1223 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:00.985623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:00.986242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:00.992276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.992763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.993212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:00.993901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:00.994359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:00.994790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.123034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:01.131149 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-24d58870-46ff-4124-b9b2-40d79dcad7fb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.149373 Sep 07 14:49:01.132251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 260/535] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:00 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:01.208597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:01.209225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:01.215544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.216023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.216526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.217212 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.217661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.218080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.342910 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:01.350595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-84362d58-b1e2-4266-a41e-6384885192b1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.145866 Sep 07 14:49:01.351186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 276/536] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:01 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:01.756865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:01.757472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:01.763296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.763776 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.764275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.765183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.765949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.766622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.792737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:01.793405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:01.800071 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.800595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.801054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.801752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.802795 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.803224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.960748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:01.969679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:01.974762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:01.974762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8298bf20-6afe-48a3-b5ed-3be2ef4fba88 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.220420 Sep 07 14:49:01.974762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 261/537] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:01 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:01.979496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:01.980094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:01.986204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.986684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.987114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.987795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:01.988449 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:01.988864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:01.999326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:02.008087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2218a287-60ea-44cf-a520-63d715769872 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.219347 Sep 07 14:49:02.009100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 277/538] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:01 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:02.088553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:02.096432 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-18f0dc46-e509-4296-915f-1cc5bef104e1 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1223 microversion: 2.1 time: 0.120356 Sep 07 14:49:02.097152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 262/539] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:01 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1223 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:02.162877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:02.167103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:02.179934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:02.180881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:02.182051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:02.185026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:02.185741 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:02.186382 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:02.375203 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:02.376379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:02.383489 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:02.384127 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:02.384732 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:02.385588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:02.387037 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:02.388394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:02.399304 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:02.418414 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-69f09648-f617-4dfa-8c82-f6550c512ca2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1371 microversion: 2.1 time: 0.266471 Sep 07 14:49:02.419701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 278/540] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:02 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1371 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:02.539500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:02.548224 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-473529fe-1e46-4c46-ae0d-13d807871168 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.178271 Sep 07 14:49:02.548993 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 263/541] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:02 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:03.001405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.002118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.015653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.016322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.017133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.018148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.018830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.019451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.031170 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.032502 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.049676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.050174 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.050620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.051421 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.052231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.053010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.410769 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.435455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.437220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.448933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c12cf320-2286-4542-99af-6f4e40057588 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.442966 Sep 07 14:49:03.463968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 279/542] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:02 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:03.464793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.477135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9a3a3257-3226-4916-b75d-d98839378406 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1468 microversion: 2.1 time: 0.449749 Sep 07 14:49:03.478493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 264/543] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:03 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1468 bytes in 452 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:03.486024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.487816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.489177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.491487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.499185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.500547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.501485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.502846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.503049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.504704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.504828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.505916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.508518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.509383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.509953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.510627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.600649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.614146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-261b02cb-7f0f-4a21-b333-5e11a9f1ac89 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1271 microversion: 2.1 time: 0.146963 Sep 07 14:49:03.615038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 280/544] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:03 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1271 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:03.641642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.643655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.652547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.658202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.658202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.658202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.658202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.658547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.786774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.799177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c5145310-9a8a-4159-91d7-9fc4c97022a5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1565 microversion: 2.1 time: 0.319367 Sep 07 14:49:03.800405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 265/545] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:03 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1565 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:03.827333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:03.827841 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:03.841855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.842706 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.843332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.844478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:03.845072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:03.845683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:03.911706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:03.919892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-db87b3ce-df2f-4ac6-bdd5-42c310f28b8c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1681 microversion: 2.1 time: 0.294002 Sep 07 14:49:03.920378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 281/546] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:03 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1681 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:03.983938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3ee8bab6-2299-4db2-af86-a19aa7e6ba4a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.161138 Sep 07 14:49:03.993368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 266/547] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:49:03 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:04.489270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:04.494650 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:04.498075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.506292 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:04.507722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:04.507898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.508405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:04.509175 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.509635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.510076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:04.529070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.531376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.532069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:04.544701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.547187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.547817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:04.892731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:04.911515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-102ab935-418c-434c-beb3-f2ce06772e68 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1426 microversion: 2.1 time: 0.409518 Sep 07 14:49:04.919974 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 267/548] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:04 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1426 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:04.935500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:04.951028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:04.986191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.987703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.991597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:04.992969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:04.995914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:04.996910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:05.009326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:05.025796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:05.032485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:05.039283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ae298c3d-b224-4956-8033-2ffbd8628f66 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.553625 Sep 07 14:49:05.040496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 282/549] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:04 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:05.045333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ca2fd683-c37c-4d42-a2ee-274aac79720c", "name": "network-vif-deleted", "tag": "f5edc385-2d4f-4b23-8598-0924b8b0c26c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:05.073883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:05.074704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:05.075342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:05.102188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] Creating event network-vif-deleted:f5edc385-2d4f-4b23-8598-0924b8b0c26c for instance ca2fd683-c37c-4d42-a2ee-274aac79720c on hv-cinder-80135 Sep 07 14:49:05.115270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-dca8322b-7257-4135-9bbe-f8e4af1c267d req-40454ab5-3daf-4635-9fa5-181fab234731 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072675 Sep 07 14:49:05.118709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 283/550] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:05.130996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:05.137285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:05.151374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:05.152418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:05.153075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:05.154278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:05.154984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:05.155613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:05.501445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:05.513848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8aabf5dd-c1e6-49a1-aedd-5cfd1074ad71 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1277 microversion: 2.1 time: 0.591576 Sep 07 14:49:05.534894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 268/551] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:04 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1277 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:05.941370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:05.944558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:05.964779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:05.965932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:05.968780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:05.969730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:05.970356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:05.972701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.055259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:06.059118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.073858 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5241b99f-8c4a-49fa-9a48-55385023585d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1613 microversion: 2.1 time: 0.953204 Sep 07 14:49:06.075349 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 284/552] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:05 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1613 bytes in 956 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:06.089197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:06.090232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:06.097168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:06.098358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:06.100564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:06.105688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.105688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lazy-loading 'fault' on Instance uuid ca2fd683-c37c-4d42-a2ee-274aac79720c {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:06.105905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:06.105905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.108901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:06.109660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:06.110327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.163856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:06.529105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '133ae50f4b814e978c875bf61a9db611', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c7e0ace10fe241aba9f2ab06d05b0032', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.543261 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7f03f8d9-5f94-4a62-b3b5-fc1306f130e5 tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 200 len: 1303 microversion: 2.1 time: 0.607004 Sep 07 14:49:06.549504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 269/553] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:05 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 1303 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:06.583012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:06.584368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:06.625301 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:06.628857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:06.649029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.655407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:06.655407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:06.655407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:06.763077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.773848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.778482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.781965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c1bcb9d6-db04-4b13-930c-b1914c26df36 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.703876 Sep 07 14:49:06.783295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 285/554] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:06 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:06.833022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:06.848098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2ac6466b-7564-488b-aa8e-1a9d61a95353 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1277 microversion: 2.1 time: 0.281898 Sep 07 14:49:06.853038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 270/555] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:06 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1277 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:07.111341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:07.112802 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:07.134832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.135973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.136673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.137503 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.138053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.138576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.185347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6cbc686c-776f-41cd-96ee-331395bc2204", "name": "network-vif-deleted", "tag": "6266f7d7-1f76-4249-87ce-c231a8e55ee0"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:07.202423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.204031 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.207634 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.228195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.229229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.229976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.230670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid 6cbc686c-776f-41cd-96ee-331395bc2204 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:07.239872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] Creating event network-vif-deleted:6266f7d7-1f76-4249-87ce-c231a8e55ee0 for instance 6cbc686c-776f-41cd-96ee-331395bc2204 on hv-cinder-80135 Sep 07 14:49:07.258152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-bd8a6e16-d9d1-4b9c-ba2b-c9dc4b24f427 req-96b498ae-ba31-4346-a24a-da4c189e281b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.076267 Sep 07 14:49:07.259603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 271/556] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:07.364132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:07.379237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1524e164-8a14-4772-9c83-f1683b7256f1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1332 microversion: 2.1 time: 0.284085 Sep 07 14:49:07.388747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 286/557] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:07 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1332 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:07.580945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:07.582569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] [instance: ca2fd683-c37c-4d42-a2ee-274aac79720c] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:07.601482 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.603757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.604618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.607020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.613055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.614034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.674855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] HTTP exception thrown: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Request method failure captured: Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c HTTP/1.1 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK8qscPSIOvEwQ6ssOpWgPN0CCXCItvvo7UCMbG44omngGckBIeNU7TmVvyRTdAikYrFLqtt6Sf1EFJt34_1ZkVHZZvH2lryaq2S_rGLv6JJH6oYyiMnlqDEc5rcjHZr5GHQphiVzroRh5S1p95Z2ZuqIM2awYe4dAf_rnTNbTEnR6g Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: c7e0ace10fe241aba9f2ab06d05b0032 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesNegativeTest-1675978359 Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:49:07.685038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_c7e0ace10fe241aba9f2ab06d05b0032"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7e0ace10fe241aba9f2ab06d05b0032"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/c7e0ace10fe241aba9f2ab06d05b0032"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/c7e0ace10fe241aba9f2ab06d05b0032"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesNegativeTest-1675978359 Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: c7e0ace10fe241aba9f2ab06d05b0032 Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesNegativeTest-1675978359 Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesNegativeTest-1675978359-project Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 133ae50f4b814e978c875bf61a9db611 Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesNegativeTest-1675978359-project Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. Sep 07 14:49:07.686581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'ca2fd683-c37c-4d42-a2ee-274aac79720c'} Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:49:07.687461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. Sep 07 14:49:07.689209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:49:07.691514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] Returning 404 to user: Instance ca2fd683-c37c-4d42-a2ee-274aac79720c could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:49:07.692028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d01b0415-f970-488c-99a8-72b7cc8bca6d tempest-VolumesNegativeTest-1675978359 tempest-VolumesNegativeTest-1675978359-project] 10.222.0.57 "GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c" status: 404 len: 111 microversion: 2.1 time: 0.115139 Sep 07 14:49:07.696702 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 272/558] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:07 2022] GET /compute/v2.1/servers/ca2fd683-c37c-4d42-a2ee-274aac79720c => generated 111 bytes in 121 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:07.817038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:07.818019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:07.830883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:07.832549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.835967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.836429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.837445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.840719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.842565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.878681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:07.879672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:07.892496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.896811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.897560 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:07.898582 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:07.901751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:07.902522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:08.756962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:08.775277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:08.776766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:08.781272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5ffffff5-b126-417b-bf98-df3b3eaa4421 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.968822 Sep 07 14:49:08.783979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:08.784676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 287/559] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:07 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 973 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:08.793636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:08.798317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:08.798869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-540cbbf6-cb5d-4d0d-a179-366eb85339b3 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.918940 Sep 07 14:49:08.812610 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 273/560] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:07 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:49:08.813119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:08.813619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:08.814946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:08.815067 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:08.815514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:08.815940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:08.926886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:08.928704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:08.933131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:08.933131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid 6cbc686c-776f-41cd-96ee-331395bc2204 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:09.076624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:09.110305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e8c6ae80-e5f1-40fb-9038-0a8ee37204e9 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 200 len: 1332 microversion: 2.1 time: 0.319706 Sep 07 14:49:09.110305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 288/561] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:08 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 1332 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:09.260450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:09.284503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:09.285137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:09.292962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:09.313155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] Creating event network-changed:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:49:09.326188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-8bce5aed-abef-4b61-babc-1b437709e8b5 req-154b11a2-f077-4c5d-8fd5-fd4103516044 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.069746 Sep 07 14:49:09.329071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 274/562] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:09.818190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:09.819640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:09.835672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:09.837685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:09.845531 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:09.850918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:09.851074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:09.852913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:09.853124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:09.854492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:09.854834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:09.855818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:09.856889 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:09.858617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:09.859123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:09.860230 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:09.860735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:09.861799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:09.861994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:10.432636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:10.462671 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:10.484401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:10.488620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7ff83d88-f9f7-4c57-b21c-962ac794103e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.679529 Sep 07 14:49:10.492862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 289/563] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:09 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:10.500639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:10.528829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:10.528829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:10.528829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:10.528829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:10.529510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:10.529510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:10.529510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:10.558057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:49:10.558339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Wed Sep 7 14:49:10 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 (ip 10.222.0.57) !!! Sep 07 14:49:10.565286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 HTTP/1.1 Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:49:10.567276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:49:10.569692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '6cbc686c-776f-41cd-96ee-331395bc2204'} Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:49:10.570740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:49:10.572502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:10.577089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:49:10.578737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-905b2d99-3e97-485e-8ed8-14495ef149e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 404 len: 111 microversion: 2.1 time: 0.083906 Sep 07 14:49:10.578879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:10.583538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 290/564] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:10 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 111 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:10.595723 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-11b1a4e7-b171-4147-85fe-b790fc97b284 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.769338 Sep 07 14:49:10.596339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 275/565] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:09 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:10.600501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d6a833b3-591e-467a-86ca-cabcebe5d4b7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '.version_select at 0x7fefdf8795e0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:11.105767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d6a833b3-591e-467a-86ca-cabcebe5d4b7 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137689577" status: 202 len: 0 microversion: 2.1 time: 0.516891 Sep 07 14:49:11.107628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 291/566] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:49:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2137689577 => generated 0 bytes in 519 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:49:11.391672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe0000e7-6ac2-4c18-889c-0cb869346ba0", "tag": "58daf86e-cad0-4789-aafd-8cb9f9082866"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:11.413479 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:11.415842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:11.416614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:11.437258 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] Creating event network-changed:58daf86e-cad0-4789-aafd-8cb9f9082866 for instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 on hv-cinder-80135 Sep 07 14:49:11.443366 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-121e5b5c-a1c6-4fb9-bade-6ec6ba98df2f req-6d7dff59-dfc1-481d-968b-99c7bdd6e8e5 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056132 Sep 07 14:49:11.448739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 276/567] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:11.517364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:11.521892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:11.537813 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:11.538818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:11.539491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:11.540487 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:11.541151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:11.544481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:11.623636 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:11.624685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:11.637014 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:11.637803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:11.638729 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:11.641137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:11.641778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:11.642871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:11.985103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:12.000203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:12.011494 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:12.014753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f9da2ebf-8f28-415b-a7fb-960f03dee699 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.501103 Sep 07 14:49:12.021427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 292/568] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:11 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:12.051457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:12.064117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a86d7f8a-4d9f-4d91-8ed2-cf03720335bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.445080 Sep 07 14:49:12.081498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 277/569] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:11 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:13.053865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:13.054492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:13.065685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.066178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.066611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.067313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.067794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.072670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.091357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:13.095131 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:13.111984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.112972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.113760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.118507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.120185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.121061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.386733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:13.390536 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:13.400033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-668f3160-1bd9-48f7-8cf6-52feca0e67fb tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.315270 Sep 07 14:49:13.408212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 278/570] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:13 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:13.413178 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:13.416722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:13.419033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:13.421547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:13.426257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ab1a3b56-d5f2-41ec-9c08-da7664259920 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.377790 Sep 07 14:49:13.433950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.434451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.434896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.435613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:13.436066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:13.436527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:13.439500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 293/571] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:13 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:13.738668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'services' on Instance uuid be5f6be2-5405-4fec-9c2c-584b8e270d1a {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:14.070046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-db65e2f4-8b3a-4eb4-87a2-a68f17a5afcc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments/62921461-3282-4f4f-bc1e-7deae1fba834" status: 202 len: 0 microversion: 2.1 time: 0.668031 Sep 07 14:49:14.078069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 279/572] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:49:13 2022] DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments/62921461-3282-4f4f-bc1e-7deae1fba834 => generated 0 bytes in 669 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:49:14.082327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:14.089688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:14.106257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.106257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.106257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:14.106257 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.106721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.106721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:14.157478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d1530f99-7fe3-4d4f-93e3-b37c3697e9fc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.082222 Sep 07 14:49:14.158210 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 294/573] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:49:14 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 197 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:14.441248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:14.443636 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:14.469793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:14.470842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:14.475190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.475877 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.479997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.480950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.481735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:14.482822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.483679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.484447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:14.485044 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:14.488813 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:14.491782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:14.492510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:15.182481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:15.183103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:15.190945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4357637e-4798-4d06-8b46-d153e10c1550 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.765643 Sep 07 14:49:15.204177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 280/574] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:14 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 768 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:15.204177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:15.204177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:15.206589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:15.211012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:15.211012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:15.211012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:15.211012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:15.211417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:15.221374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:15.223177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:15.228290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4436ebc-42f8-4a80-8850-7600708eadd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.763849 Sep 07 14:49:15.236263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 295/575] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:14 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:15.257771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-66139ab1-3b1f-4ef2-b7ab-d5783e6b9254 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.063539 Sep 07 14:49:15.258383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 281/576] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:49:15 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 197 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:16.220850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:16.222441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:16.230514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.231316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.231979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.233473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.234152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.234811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.264755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:16.265424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:16.282625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.283138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.283575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.284344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.288941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.289651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.508275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:16.516686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5699b025-dd67-4ee0-8b46-a3f99f094104 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.301082 Sep 07 14:49:16.520937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 296/577] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:16 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:16.526107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:16.533862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:16.543551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:16.551609 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.553076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.560120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:16.560305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.560305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:16.560685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:16.560807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:16.560807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:16.560967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e201036d-8526-4c21-aa2c-82c913b7978e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.297016 Sep 07 14:49:16.560967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 282/578] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:16 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:49:16.628525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-359c71a1-24be-4ca7-a962-4b4f2f838421 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.106111 Sep 07 14:49:16.629316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 297/579] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:49:16 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 197 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:17.543380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:17.566011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:17.566011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.566011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.566011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.566452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.566452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.566452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.607871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:17.609323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:17.622681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.623572 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.624337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.625351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.626180 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.627159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.855101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:17.863737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-804e2ed7-6a94-4f41-a2e6-61319bf776ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.324225 Sep 07 14:49:17.865695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 283/580] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:17 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:17.870799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:17.873373 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:17.894935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.895911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.896039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:17.898146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.899139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:17.900486 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:17.902097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:17.912663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:17.914921 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:17.916511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e9f98371-17a9-4f6a-8146-dca1c2a00ac8 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.313091 Sep 07 14:49:17.918414 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 298/581] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:17 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:17.947001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8b7b2504-fb7d-44a3-a783-3585b51b839c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079810 Sep 07 14:49:17.951848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 284/582] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:49:17 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 197 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:18.897354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:18.898845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:18.907910 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:18.909458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:18.910094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:18.911024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:18.912228 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:18.917662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:18.947091 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:18.948282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:18.954878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:18.955581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:18.957574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:18.957574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:18.957574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:18.958748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.147405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:19.151986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:19.161063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-277b3951-63ee-4a58-b126-bc44b475eb60 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.269683 Sep 07 14:49:19.162129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 299/583] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:18 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:19.162254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:19.164388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:19.165780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-080f4763-78a5-4b0d-a256-e990b9a0b903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.224211 Sep 07 14:49:19.176662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:19.177393 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 285/584] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:18 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:49:19.181499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:19.189929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.190424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.190888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.191656 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.192167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.193190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.244283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2f8e70d6-6a46-47fc-a218-461a11a439a3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077563 Sep 07 14:49:19.245195 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 300/585] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:49:19 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:49:19.315119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:19.315613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:19.322490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.322975 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.323397 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.324305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.324907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.325658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.359354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:49:19.392811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:19.686749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a28c912b-f044-4375-a1e5-42a1140b00e5 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 204 len: 0 microversion: 2.1 time: 0.375367 Sep 07 14:49:19.687332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 286/586] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:49:19 2022] DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 0 bytes in 377 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:49:19.695935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:19.700106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:19.703562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.704478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.704683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.705607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:19.706065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:19.706490 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:19.876194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:19.889237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1c78cbf4-5468-4efc-92dd-58e92f1a5a84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1682 microversion: 2.1 time: 0.196972 Sep 07 14:49:19.907743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 301/587] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:19 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1682 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:20.186673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:20.188035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:20.191595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:20.194159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:20.196701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.204928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.206516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.208285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.209865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.210964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.211721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.213331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.213621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.215504 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.216109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.220004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.446208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:20.457589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:20.459509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:20.464424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:20.472088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-41fba49e-e8e3-47fe-9e13-1444d9424d3e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.274376 Sep 07 14:49:20.481144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-360d9cfb-6aed-4503-9c5b-927ab6e0d0ee tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.291551 Sep 07 14:49:20.495339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 302/588] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:20 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:20.495656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 287/589] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:20 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:20.921124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:20.922044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:20.930880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.931915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.932507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.933707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:20.934956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:20.935749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:20.942892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:21.135127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:21.144908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c430c5b-d4ef-4914-ad4c-7d09ab90c899 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1682 microversion: 2.1 time: 0.228988 Sep 07 14:49:21.146405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 303/590] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:20 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1682 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:21.498496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:21.500094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:21.502730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:21.503701 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:21.514497 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:21.515797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:21.516500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:21.517690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:21.518348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:21.519105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:21.523136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:21.523471 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:21.524027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:21.528766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:21.530241 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:21.532309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:21.771501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:21.784995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:21.793106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:21.794525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-16f993fe-5293-453e-bd0d-6692f38a2bec tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.298644 Sep 07 14:49:21.808173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 304/591] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:21 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:21.828864 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:21.840072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d89d9b3d-4207-4b78-9a31-e2cc4a39ba4b tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.347158 Sep 07 14:49:21.843567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 288/592] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:21 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:22.173418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:22.174119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:22.193342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.193342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.193342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:22.193342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.193874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.193874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:22.375176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:22.383697 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-67815347-4990-4900-a7f6-4907130eb071 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1682 microversion: 2.1 time: 0.216012 Sep 07 14:49:22.384897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 305/593] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:22 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1682 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:22.821158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:22.821752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:22.840435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.840929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.841353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:22.842048 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.842504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.843018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:22.866121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:22.867312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:22.874542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.875327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.875946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:22.877146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:22.877822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:22.878625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:23.199173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:23.209163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-405a78f3-598e-4153-943c-1edf19983237 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.347322 Sep 07 14:49:23.209736 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 306/594] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:22 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:49:23.221626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "be5f6be2-5405-4fec-9c2c-584b8e270d1a", "name": "network-vif-deleted", "tag": "24b0bebe-bbc1-43a9-9520-065202c5da6c"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:23.235442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:23.248382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:23.249412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:23.249880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:23.250303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:23.251329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:23.253156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6b2ceafb-1cb1-4909-8ff9-2c288abda401 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.435694 Sep 07 14:49:23.255840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 289/595] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:22 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:49:23.285509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] Creating event network-vif-deleted:24b0bebe-bbc1-43a9-9520-065202c5da6c for instance be5f6be2-5405-4fec-9c2c-584b8e270d1a on hv-cinder-80135 Sep 07 14:49:23.293179 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-9891c141-12ea-411d-a263-22e2bbb804c6 req-11599799-ffe7-4492-ba58-f0eaac16946e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.079240 Sep 07 14:49:23.301427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 307/596] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:23.419225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:23.419862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:23.428930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:23.429416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:23.429844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:23.430529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:23.434240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:23.435062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:23.494946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:23.499470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:23.499956 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:23.500552 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid be5f6be2-5405-4fec-9c2c-584b8e270d1a {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:23.578013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:23.591662 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e3c1ee77-2b2d-48ed-9857-1012f294faf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1331 microversion: 2.1 time: 0.176449 Sep 07 14:49:23.605241 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 290/597] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:23 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1331 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:24.023570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0000e7-6ac2-4c18-889c-0cb869346ba0", "name": "network-vif-plugged", "status": "completed", "tag": "58daf86e-cad0-4789-aafd-8cb9f9082866"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:24.034375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.035034 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.035478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.046992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] Creating event network-vif-plugged:58daf86e-cad0-4789-aafd-8cb9f9082866 for instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 on hv-cinder-80135 Sep 07 14:49:24.051707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-27940190-ab0b-48ae-a0ad-99d9af4b7a14 req-73b08f6b-af18-43f0-8d01-71e8332065f0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034574 Sep 07 14:49:24.054224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 308/598] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:24.233141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:24.233756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:24.240728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.241228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.241656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.242349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.242860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.243298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.286030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:24.286756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:24.294553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.295039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.296001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.296743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.297380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.298073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.432821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:24.442276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ad9b7863-f218-4443-81b0-5643c5b190ec tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.213114 Sep 07 14:49:24.443502 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 291/599] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:24 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:24.484630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:24.494854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:24.496360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:24.497788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-79c686e3-315b-4dd9-90c9-499c2da75a6d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.216302 Sep 07 14:49:24.498790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 309/600] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:24 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:24.618694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:24.619340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:24.625298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.625798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.626229 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.626912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.627360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.627779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.659492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:24.660318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:24.660770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:24.661260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid be5f6be2-5405-4fec-9c2c-584b8e270d1a {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:24.702769 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:24.710559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1694c74d-389a-4da0-9c9f-df6411b65f5a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 200 len: 1331 microversion: 2.1 time: 0.096239 Sep 07 14:49:24.711111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 292/601] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:24 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:25.467233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:25.467726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:25.474979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.475457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.475885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.476593 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.477039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.477502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.529554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:25.530736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:25.537508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.538465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.539056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.539932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.540672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.541362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.728186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:25.738061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-23c6cb86-c4ae-466a-bfed-ae72594c31bf tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1319 microversion: 2.1 time: 0.275522 Sep 07 14:49:25.740731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 310/602] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:25 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1319 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:25.747749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:25.749604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:25.763313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.764074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.764663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.765495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:25.766184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:25.766828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:25.790355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a HTTP/1.1 Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:49:25.791194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:49:25.793396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'be5f6be2-5405-4fec-9c2c-584b8e270d1a'} Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:49:25.794177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:49:25.795399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:25.797987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:49:25.799149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d91caa1a-9350-4caf-b9fb-d0c7fa8ae729 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 404 len: 111 microversion: 2.1 time: 0.057231 Sep 07 14:49:25.799876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 311/603] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:25 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:49:25.807006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:25.820160 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:25.825436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:25.827222 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-edd6dc39-a91a-443c-852a-46d43a140236 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '.version_select at 0x7fefdf8fb700>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:25.829181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ec5d996d-abec-4b77-b3aa-6fceaec9cf6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.305389 Sep 07 14:49:25.840384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 293/604] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:25 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:25.939691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-edd6dc39-a91a-443c-852a-46d43a140236 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237529868" status: 202 len: 0 microversion: 2.1 time: 0.127430 Sep 07 14:49:25.945242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 312/605] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:49:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1237529868 => generated 0 bytes in 133 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:49:26.766338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:26.766954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:26.774035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:26.774515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:26.774981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:26.775694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:26.776614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:26.781704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:26.807534 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f3895c51-ef29-4765-bea2-49a7919808f6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: .version_select at 0x7fefdf83e280>, body: {"keypair": {"name": "tempest-keypair-1617433422", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL9dbcfwNfw/3g7OoeS0rXmgiYLzrY8t0O8VXNS34xi921kTagegGW4aDXcLG+xGsx6a96WbgUUSWwJaJt1b5TB3HkaKKVZeZSuA/ZPLHNiUQGlEFi4NiFhKh9mF5R4/Wg=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:26.825319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f3895c51-ef29-4765-bea2-49a7919808f6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:49:26.829424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f3895c51-ef29-4765-bea2-49a7919808f6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:49:26.915658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f3895c51-ef29-4765-bea2-49a7919808f6 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.114971 Sep 07 14:49:26.916877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 313/606] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:49:26 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:26.924306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:26.925097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:26.933508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:26.933997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:26.934422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:26.935361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:26.935954 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:26.936749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:26.951533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:26.970721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ae2bc49f-497a-40be-896d-f94788943de6 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1509 microversion: 2.1 time: 0.208319 Sep 07 14:49:26.972731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 294/607] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:26 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1509 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:26.995703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9f18cf52-f632-4257-88bd-c7092c1e8683", "device": "/dev/sdb"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:26.998798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:27.005862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:27.006347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:27.006782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:27.007483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:27.007934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:27.008387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:27.091390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:27.102220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:27.103674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:27.104892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f654c259-fac7-4bd1-8291-ed2fbae1dd50 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.186817 Sep 07 14:49:27.105775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 314/608] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:26 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:27.675000 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "name": "network-vif-plugged", "status": "completed", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:27.685342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:27.685817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:27.686254 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:27.701869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] Creating event network-vif-plugged:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:49:27.702622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-5104b5cb-1319-4410-a1bf-75e88c7f2c78 req-46197ddd-69c7-482e-8386-cea41c08167e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031248 Sep 07 14:49:27.703217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 315/609] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:27.935588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cad4ce97-4287-4de4-a1ad-b225ba1417a7 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "POST /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.943582 Sep 07 14:49:27.940243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 295/610] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:49:26 2022] POST /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0/os-volume_attachments => generated 194 bytes in 945 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:28.131712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:28.132461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:28.138873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:28.139355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:28.139787 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:28.140558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:28.141001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:28.141417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:28.290774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:28.302731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:28.304226 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:28.305427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-05c943dd-01e1-4d9f-baba-f76eb353b195 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.178958 Sep 07 14:49:28.306176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 316/611] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:28 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:29.333802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:29.337502 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:29.340173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:29.342033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:29.342678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:29.343114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:29.343800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:29.344264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:29.344861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:29.512982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:29.523809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:29.525467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:29.526790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-52a20bae-ff8f-43af-bde2-1a798086a100 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.198696 Sep 07 14:49:29.528063 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 296/612] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:29 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:30.239124 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1281553311", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "163090f4-fd08-48b4-a9ef-0baf5dc14d96"}], "security_groups": [{"name": "tempest-securitygroup--1061561191"}], "key_name": "tempest-keypair-1617433422", "user_data": "}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:30.410317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] validate_networks() for [('163090f4-fd08-48b4-a9ef-0baf5dc14d96', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:49:30.553642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:30.560385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:30.561484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:30.561976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:30.563490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:30.565758 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:30.566384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:30.566978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:31.097284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:31.110691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:31.112121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:31.117227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-467d368c-38bb-4385-8aff-ca8bd591c2b7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.567917 Sep 07 14:49:31.118540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 297/613] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:30 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:31.276527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:49:31.277081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:49:31.277844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:49:31.278355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:49:31.278831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:49:31.290173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:31.290669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:31.291176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:31.292017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:31.292405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:31.292836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:31.331355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:49:31.339437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:49:31.358221 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:49:31.360760 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:49:31.510388 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-56db2cbf-9baa-4a84-948d-0df29fe1803a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.276901 Sep 07 14:49:31.511032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 317/614] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:49:30 2022] POST /compute/v2.1/servers => generated 402 bytes in 1278 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:49:31.523209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-15b1f178-e070-4bac-9f7c-19cb430639f3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:31.523738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-15b1f178-e070-4bac-9f7c-19cb430639f3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:31.605702 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-15b1f178-e070-4bac-9f7c-19cb430639f3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:31.617878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-15b1f178-e070-4bac-9f7c-19cb430639f3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1242 microversion: 2.1 time: 0.098947 Sep 07 14:49:31.632948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 298/615] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:31 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1242 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:32.147597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:32.148494 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:32.156826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:32.157584 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:32.158026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:32.158738 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:32.159193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:32.159647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:32.381856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:32.391020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:32.392835 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:32.394173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7dcde469-abff-463d-be2d-706b78a3c192 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1809 microversion: 2.20 time: 0.251760 Sep 07 14:49:32.394740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 318/616] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:32 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1809 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:32.640343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:32.640949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:32.648966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:32.649451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:32.649889 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:32.650581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:32.655618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:32.655618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:32.752552 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:32.778668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1b256dd1-f438-4e01-8354-c61b984554ac tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1246 microversion: 2.1 time: 0.141504 Sep 07 14:49:32.779453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 299/617] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:32 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1246 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:33.422741 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:33.423360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:33.432115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:33.432807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:33.433324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:33.434120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:33.434579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:33.435767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:33.659076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:33.670601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:33.672279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:33.674341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-98fa883d-a87b-467a-beac-c95d216f1cf2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1796 microversion: 2.20 time: 0.257157 Sep 07 14:49:33.681613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 319/618] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:49:33 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1796 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:49:33.813950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:33.834952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:33.850528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:33.851520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:33.854924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:33.854924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:33.854924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:33.854924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:34.008613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:34.021057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cadcad97-c225-41a6-a3a2-fa3cc2c4502d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1302 microversion: 2.1 time: 0.217314 Sep 07 14:49:34.022236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 300/619] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:33 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1302 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:35.046674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:35.047286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:35.054323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:35.054811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:35.055247 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:35.055939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:35.056642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:35.057065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:35.259146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:35.269080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-99343f7d-bf4c-4bf7-a57b-fda1aaee1d73 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.226033 Sep 07 14:49:35.272312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 320/620] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:35 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:36.241445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ae47dd-c46e-4a26-9a32-b659fdebd24a", "tag": "f68a3148-532c-480e-bebd-47d13cbdfa96"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:36.251719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:36.252358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:36.252967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:36.264900 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] Creating event network-changed:f68a3148-532c-480e-bebd-47d13cbdfa96 for instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a on hv-cinder-80135 Sep 07 14:49:36.270503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-adf4c036-6e53-4e1a-baad-17178e4b6ddb req-a738d0ab-a2fc-4239-b62d-5036fc5b0ba3 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033470 Sep 07 14:49:36.271085 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 301/621] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:36.302985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:36.303654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:36.324051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:36.334496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:36.335251 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:36.335855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:36.337209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:36.338586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:36.339992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:36.516968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:36.526029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9fc05cdf-e177-4eb3-8649-978ee6d2319b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.235716 Sep 07 14:49:36.526740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 321/622] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:36 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:37.550392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:37.552461 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:37.573463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:37.573871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:37.574375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:37.575387 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:37.575753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:37.576469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:37.582755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:UPDATE=3,nova_cell1:SELECT=95,nova_cell1:INSERT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:37.856979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:37.866792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a9a13134-767c-40e3-bcb3-d905ccced68a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.320840 Sep 07 14:49:37.867684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 302/623] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:37 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:49:38.889539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:38.890169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:38.897687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:38.898178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:38.898645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:38.899339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:38.899797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:38.900251 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:39.055964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:39.066585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3292d564-ef68-4062-aa09-6a920f93bb18 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.180813 Sep 07 14:49:39.080340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 322/624] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:38 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:40.093368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:40.094823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:40.101515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:40.102587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:40.103389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:40.104300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:40.105053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:40.105484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:40.252429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:40.270043 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a20722ed-1760-4b1e-89dd-6f5ba3eceec1 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.181581 Sep 07 14:49:40.271541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 303/625] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:40 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:41.296007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:41.297424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:41.304800 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:41.306809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:41.307580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:41.308230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:41.309247 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:41.309870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:41.310458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:41.366428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=10 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:41.556074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:41.564555 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0a4af7a7-0667-4913-bff6-459a5c54ee60 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.272599 Sep 07 14:49:41.567949 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 323/626] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:41 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:41.617829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:41.750403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-852f1aef-949b-4281-a1b0-16f9f631b77d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Action: 'create', calling method: .version_select at 0x7fefdf90bdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-135479397", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJtolwP6sR8VNHDPtMooI2l7628TB8pgngRoTli63Q7LTJ64dwSqAgjmWzRw7CJiGg0gQcGBKaDoaIiDopJNULhMPYPp+O7G13usk/9nyPeNhBFfbhdhVOskwSmcxFzwkA=="}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:41.765576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-852f1aef-949b-4281-a1b0-16f9f631b77d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:49:41.769781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-852f1aef-949b-4281-a1b0-16f9f631b77d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for user 2a6a637072b04667a3f21da9c57325c0 and project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:49:41.852408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-852f1aef-949b-4281-a1b0-16f9f631b77d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.320428 Sep 07 14:49:41.853001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 304/627] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:49:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:49:42.594844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:42.595453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:42.601898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:42.602322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:42.602774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:42.603464 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:42.603918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:42.604380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:42.788325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:42.796489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1cc947ae-c642-4502-b586-dc814045743a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.205534 Sep 07 14:49:42.797084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 324/628] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:42 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:43.823757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:43.824556 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:43.837980 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:43.839828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:43.840561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:43.842338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:43.843828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:43.844367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:44.008866 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:44.017042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ec48e4a6-8d39-4f99-9656-caf3cfc147f0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.198832 Sep 07 14:49:44.017635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 305/629] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:43 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:44.367958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7ff3f522-90c2-4541-a1f1-02870ea68cb2"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:44.370428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:44.377705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:44.378411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:44.379035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:44.380099 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:44.380817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:44.381247 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:44.396664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:45.040600 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:45.041308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:45.048454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:45.049192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:45.049917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:45.050888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:45.052133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:45.052754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:45.108220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-231e7fae-e9fd-4331-82dd-6df41c9f4c2b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.745351 Sep 07 14:49:45.109214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 325/630] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:49:44 2022] POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments => generated 194 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:45.236136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:45.250146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-98e46303-8f32-44b0-986b-f4ab1d6a1efa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.212838 Sep 07 14:49:45.257688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 306/631] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:45 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:49:46.275696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:46.276502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:46.283185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:46.283685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:46.284166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:46.284879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:46.285337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:46.285938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:46.440878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:46.455056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6fab8ade-44ec-4926-8fc4-45012d82b063 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.183778 Sep 07 14:49:46.455648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 326/632] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:46 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:46.550403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ae47dd-c46e-4a26-9a32-b659fdebd24a", "name": "network-vif-plugged", "status": "completed", "tag": "f68a3148-532c-480e-bebd-47d13cbdfa96"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:46.562337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:46.562821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:46.563272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:46.574311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] Creating event network-vif-plugged:f68a3148-532c-480e-bebd-47d13cbdfa96 for instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a on hv-cinder-80135 Sep 07 14:49:46.579332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-2e9cd415-ccb6-452a-8b3a-62d86331d6a6 req-bc93d1de-67bf-4663-a216-c03692a79e79 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033448 Sep 07 14:49:46.580017 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 307/633] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:47.482511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:47.483075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:47.489314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:47.489797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:47.490856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:47.491539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:47.491985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:47.492423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:47.628536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:47.636229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1838acba-d461-4e75-9e9e-68bf008818d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.157471 Sep 07 14:49:47.636791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 327/634] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:47 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:48.653606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:48.654262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:48.660965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:48.661454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:48.661891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:48.662371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:48.662899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:48.662999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:48.663103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:48.663475 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:48.669743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:48.670305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:48.670744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:48.671436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:48.671928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:48.672404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:48.761221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'services' on Instance uuid fe0000e7-6ac2-4c18-889c-0cb869346ba0 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:48.818797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:48.822608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6fb52aa0-481d-44b7-9630-17ddc0e8c123 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1368 microversion: 2.1 time: 0.164327 Sep 07 14:49:48.823177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 328/635] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:48 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1368 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:49.024307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0381f068-deb3-46c5-89f4-a0008a638d9c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0/os-volume_attachments/9f18cf52-f632-4257-88bd-c7092c1e8683" status: 202 len: 0 microversion: 2.1 time: 0.376087 Sep 07 14:49:49.025588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 308/636] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:49:48 2022] DELETE /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0/os-volume_attachments/9f18cf52-f632-4257-88bd-c7092c1e8683 => generated 0 bytes in 379 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:49:49.845121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:49.845780 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:49.852316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:49.852803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:49.853240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:49.853928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:49.854381 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:49.854806 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:49.984724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:49.993305 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36ea72f1-8c14-46ed-9c13-5e903c1fdf84 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1558 microversion: 2.1 time: 0.152033 Sep 07 14:49:49.994539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 329/637] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:49 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1558 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:50.017541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:50.018642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:50.025334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:50.025821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:50.026260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:50.026952 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:50.027408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:50.027839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:50.121216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-08e4e148-aea5-49ee-a936-39746a6bee29 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.107939 Sep 07 14:49:50.121835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 309/638] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:49:50 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-interface => generated 284 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:51.143696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c5ae47dd-c46e-4a26-9a32-b659fdebd24a", "tag": "f68a3148-532c-480e-bebd-47d13cbdfa96"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:51.153674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:51.154177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:51.154608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:51.166481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] Creating event network-changed:f68a3148-532c-480e-bebd-47d13cbdfa96 for instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a on hv-cinder-80135 Sep 07 14:49:51.171470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-2fedacf0-1ee2-4a98-8724-210fcd0c6da3 req-625bdfc1-7d19-43bc-b231-8ac112248b27 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031527 Sep 07 14:49:51.172156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 330/639] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:52.695857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=4 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:49:52.700727 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:52.703058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:52.709264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:52.709876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:52.710379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:52.711111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:52.711586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:52.712015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:52.737193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'flavor' on Instance uuid caf09108-7a72-4873-90be-3c0e907ab2a0 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:53.056665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-164b9891-d9bb-403d-b926-d27285014dd6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/action" status: 200 len: 32 microversion: 2.1 time: 0.361721 Sep 07 14:49:53.057193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 310/640] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:49:52 2022] POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/action => generated 32 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:49:53.068634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:53.069396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:53.075556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:53.076029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:53.076496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:53.077177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:53.077620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:53.078040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:53.226301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:53.234561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7c2c9f2c-63a7-4714-96bc-6142225fc5a4 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.171044 Sep 07 14:49:53.235133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 331/641] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:53 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:54.258047 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:54.258737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:54.267778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.268544 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.268982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.269668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.270121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.270579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.410109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:54.419546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-99a601c8-f7bc-45fa-8666-3a1aa528d726 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.166270 Sep 07 14:49:54.420156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 311/642] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:54 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:54.433867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:54.434411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:54.441205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.441689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.442148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.442850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.443302 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.443816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.468876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:49:54.730996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a70993f2-e75e-468e-b5ee-66e426722c61 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "DELETE /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 204 len: 0 microversion: 2.1 time: 0.301176 Sep 07 14:49:54.731507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 332/643] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:49:54 2022] DELETE /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:49:54.739601 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:54.740267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:54.746244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.746724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.747164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.747850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:54.748339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:54.748767 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:54.883737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:54.891427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5fa631a7-be97-42cd-bbe4-d4bc66040e4c tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1515 microversion: 2.1 time: 0.155663 Sep 07 14:49:54.891992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 312/644] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:54 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:55.442676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:55.443375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:55.449801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:55.450283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:55.450712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:55.451392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:55.451844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:55.452299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:55.586149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:55.594361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cbaaefc5-8899-41ef-93e5-52470aa9bf72 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.155952 Sep 07 14:49:55.594926 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 333/645] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:55 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:55.915166 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:55.915810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:55.922264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:55.927571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:55.927571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:55.927571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:55.927571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:55.927945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:56.054266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:56.062785 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fc1f2fe5-fa05-4f31-b658-a1c4f80f1f68 tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1515 microversion: 2.1 time: 0.151586 Sep 07 14:49:56.063344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 313/646] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:55 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1515 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:56.617893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:56.618491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:56.624858 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:56.625388 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:56.625831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:56.626556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:56.627011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:56.627437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:56.768481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:56.777312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-992ff6b0-f8c0-467b-ac8a-a8eac06c996b tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.163945 Sep 07 14:49:56.777884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 334/647] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:56 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:57.086380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:57.087000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:57.093458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:57.093945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:57.094414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:57.095122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:57.095577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:57.096006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:57.228969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:57.236687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e4e1c729-4482-4bf2-9c2b-367622a1b15d tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1515 microversion: 2.1 time: 0.154970 Sep 07 14:49:57.237250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 314/648] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:57 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1515 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:57.385380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe0000e7-6ac2-4c18-889c-0cb869346ba0", "name": "network-vif-deleted", "tag": "58daf86e-cad0-4789-aafd-8cb9f9082866"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:49:57.396785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:57.397120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:57.397548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:57.409219 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] Creating event network-vif-deleted:58daf86e-cad0-4789-aafd-8cb9f9082866 for instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 on hv-cinder-80135 Sep 07 14:49:57.414192 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-0491091d-7de8-4f7d-bcfd-0725204197a8 req-64030bb9-91a1-4d26-93b7-2e4322ebbc2f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032959 Sep 07 14:49:57.415043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 335/649] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:49:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:49:57.807376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:57.808123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:57.814189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:57.814783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:57.815240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:57.815940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:57.816419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:57.816843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:57.954385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:57.972710 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6d1e6691-134a-43f9-b318-4ac9e1bab4d1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.167148 Sep 07 14:49:57.972710 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 315/650] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:57 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:58.260849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:58.261537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:58.268374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:58.268854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:58.269280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:58.269955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:58.270400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:58.270812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:58.300622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:58.301090 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:58.301514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:58.301947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lazy-loading 'fault' on Instance uuid fe0000e7-6ac2-4c18-889c-0cb869346ba0 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:49:58.346978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cfd87fa14f924cb897959950c79739ef', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2ed99ce2509c4163b314baa4cf3e5ae5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:58.356541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6d692620-1464-4e6c-9f7e-6c452338e6aa tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 200 len: 1309 microversion: 2.1 time: 0.099882 Sep 07 14:49:58.357127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 336/651] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:58 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 1309 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:58.995278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:58.995912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:59.002364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:59.002837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:59.003276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:59.003959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:59.004445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:59.004868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:59.131441 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:49:59.140249 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fca6e5b2-aa97-4f82-8c0d-9302bb137ec1 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.149326 Sep 07 14:49:59.140812 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 316/652] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:58 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:49:59.379264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:49:59.379874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] [instance: fe0000e7-6ac2-4c18-889c-0cb869346ba0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:49:59.386324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:59.386828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:59.387263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:59.387947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:49:59.388423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:49:59.388847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:49:59.402094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] HTTP exception thrown: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Request method failure captured: Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 HTTP/1.1 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK7fd7goJdogJL_jE_h9W_8lHVQyTmA2wWbH1eWCc5M2C2a3k9MBg6JXI6f-HNv1qnKdEyw01okdp6Ej76NuQdbbk9ZMI6m0s9wRHo93p9FodTmWEc4_CWy2w172hqK5r406zhUcl_IzwAlRxz2521KT9e3o_payHBTNaq4-9mOSgEE Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2ed99ce2509c4163b314baa4cf3e5ae5 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:49:59.403696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2ed99ce2509c4163b314baa4cf3e5ae5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2ed99ce2509c4163b314baa4cf3e5ae5 Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-350011363 Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesSnapshotTestJSON-350011363-project Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: cfd87fa14f924cb897959950c79739ef Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesSnapshotTestJSON-350011363-project Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. Sep 07 14:49:59.405310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'fe0000e7-6ac2-4c18-889c-0cb869346ba0'} Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:49:59.406237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. Sep 07 14:49:59.407722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:49:59.408928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] Returning 404 to user: Instance fe0000e7-6ac2-4c18-889c-0cb869346ba0 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:49:59.408928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-882ec2e9-fce7-4665-bab5-a6a9b6e7ed6e tempest-VolumesSnapshotTestJSON-350011363 tempest-VolumesSnapshotTestJSON-350011363-project] 10.222.0.57 "GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0" status: 404 len: 111 microversion: 2.1 time: 0.029701 Sep 07 14:49:59.408928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 337/653] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:49:59 2022] GET /compute/v2.1/servers/fe0000e7-6ac2-4c18-889c-0cb869346ba0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:50:00.162692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:00.163295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:00.170268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:00.170740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:00.171165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:00.171843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:00.172313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:00.172732 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:00.305567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:00.313736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9c78df06-0257-4fdb-bbbd-2ec2e8a4b00f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.154919 Sep 07 14:50:00.314294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 317/654] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:00 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:01.336898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:01.337517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:01.344091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:01.344607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:01.345051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:01.345762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:01.346202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:01.346626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:01.477125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:01.485814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fdf033d0-06c1-4c1a-9e9e-1c07aa70497d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.152950 Sep 07 14:50:01.486384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 338/655] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:01 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:02.509436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:02.510060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:02.512480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:02.517179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:02.517665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:02.518354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:02.519036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:02.519490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:02.519911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:02.523880 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:02.649422 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:02.657500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ed19bc86-1c5c-4833-a119-2fc56d4a52dc tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.152426 Sep 07 14:50:02.658057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 318/656] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:02 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:03.681410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:03.682035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:03.688668 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:03.689141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:03.689570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:03.690306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:03.690758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:03.691176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:03.822628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:03.830953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-840fa336-bd6c-4d89-9d42-f78e25765e11 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.153947 Sep 07 14:50:03.831519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 339/657] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:03 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:04.854237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:04.854846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:04.861550 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:04.862025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:04.862456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:04.863141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:04.863590 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:04.864009 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:04.999846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:05.008108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dfa90606-af8f-4aa5-aaf1-be3c6ce69065 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.157958 Sep 07 14:50:05.008743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 319/658] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:04 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:05.496739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1506669884", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-135479397", "security_groups": [{"name": "tempest-secgroup-smoke-1950875329"}], "block_device_mapping_v2": [{"uuid": "92725c2f-1527-4a26-980c-d4b4135bc870", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9357d86c-16cb-4519-9361-47152bec4c44"}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:05.611318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] validate_networks() for [('9357d86c-16cb-4519-9361-47152bec4c44', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:50:05.977017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:50:05.977637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:50:05.978132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:50:05.978535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:50:05.978938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:50:05.988174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:05.990111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:05.990111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:05.990111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:05.990387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:05.990678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:06.007316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:50:06.012332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for user 2a6a637072b04667a3f21da9c57325c0 and project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:50:06.042024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:06.043532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:06.050112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:06.050911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:06.051348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:06.052334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:06.052797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:06.053382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:06.083203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:50:06.086423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92725c2f-1527-4a26-980c-d4b4135bc870',volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:50:06.228469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:06.236687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d10e0435-b201-4631-9361-09f0fa237fb0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.199353 Sep 07 14:50:06.237802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 320/659] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:06 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:06.486908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-97d0546b-c124-4826-b5d3-f0f1015990cc tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.994114 Sep 07 14:50:06.488064 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 340/660] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:50:05 2022] POST /compute/v2.1/servers => generated 406 bytes in 996 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:50:06.499843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-70125abc-4a01-4cd3-aaa1-b17f6dd82e82 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:06.500492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-70125abc-4a01-4cd3-aaa1-b17f6dd82e82 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:06.553617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-70125abc-4a01-4cd3-aaa1-b17f6dd82e82 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:06.561951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-70125abc-4a01-4cd3-aaa1-b17f6dd82e82 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1094 microversion: 2.1 time: 0.065571 Sep 07 14:50:06.565745 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 321/661] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:06 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1094 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:07.261047 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:07.263159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:07.268819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:07.269499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:07.270202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:07.270814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:07.271273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:07.271709 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:07.280763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:07.407744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:07.415989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0c2915f0-1963-4941-876d-0c425276b0fe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.159543 Sep 07 14:50:07.416578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 341/662] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:07 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:07.583636 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:07.584257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:07.591042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:07.591528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:07.592028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:07.592964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:07.593426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:07.593857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:07.657892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:07.665905 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eab49494-3eec-4832-be3a-b54b104bbd43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1144 microversion: 2.1 time: 0.086399 Sep 07 14:50:07.667352 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 322/663] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:07 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1144 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:08.439613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:08.440315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:08.447162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:08.447640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:08.448069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:08.448791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:08.449241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:08.449658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:08.582060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:08.595746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24aee362-6e10-4d2d-b95e-13a92203c5c5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.160194 Sep 07 14:50:08.596681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 342/664] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:08 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:08.689211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:08.689984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:08.696582 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:08.697078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:08.697517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:08.698217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:08.698677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:08.699106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:08.765033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:08.774022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ccca68dc-2ffd-491b-8d82-f582f5fbca43 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1192 microversion: 2.1 time: 0.088812 Sep 07 14:50:08.775301 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 323/665] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:08 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:09.621858 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:09.622566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:09.627993 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:09.629796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:09.630350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:09.630782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:09.631485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:09.632046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:09.632540 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:09.797255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:09.798286 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:09.798908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:09.803009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-af7e6ace-493e-4e7f-b25c-6bf458ceb700 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.186481 Sep 07 14:50:09.803746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 343/666] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:09 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:09.806632 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:09.807120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:09.807553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:09.808284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:09.808737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:09.809157 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:09.947298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:09.955339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d50f713e-7923-474d-b002-6f0175167f8a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1278 microversion: 2.1 time: 0.161848 Sep 07 14:50:09.955924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 324/667] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:09 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1278 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:10.827473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:10.828248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:10.835023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:10.835501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:10.835926 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:10.836692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:10.837173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:10.837647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:10.888122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e91d7cf-ac5c-47f0-9b62-c666ce07c34b", "tag": "bf8cc5d8-17e1-4be8-840a-eae77e5f2b80"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:10.900003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:10.900599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:10.903587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:10.913096 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] Creating event network-changed:bf8cc5d8-17e1-4be8-840a-eae77e5f2b80 for instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b on hv-cinder-80135 Sep 07 14:50:10.918589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-cad4c8a7-ebcd-4156-8b8f-d49511a6317f req-d02b0103-78fe-413c-a1d7-8ed2ba1dd617 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035479 Sep 07 14:50:10.919420 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 325/668] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:10.979256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:10.980045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:10.986623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:10.987186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:10.987689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:10.988565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:10.989413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:10.989835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:11.004512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:11.013270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5f9ee1a9-c5e0-422f-ae9e-fb88706cc7bb tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.189633 Sep 07 14:50:11.013839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 344/669] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:10 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:11.122142 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:11.130349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-10cc74f9-5519-41d4-960e-d9b504e90b81 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.155417 Sep 07 14:50:11.130920 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 326/670] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:10 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:12.036819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:12.037437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:12.043907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:12.044424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:12.044863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:12.045556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:12.046012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:12.046439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:12.154086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:12.154714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:12.161165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:12.161652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:12.162089 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:12.162781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:12.163232 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:12.163654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:12.171840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:12.180082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3344846d-d775-4d04-a675-4720574ce2e5 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.147142 Sep 07 14:50:12.180677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 345/671] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:12 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:12.295234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:12.302701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-85630cc7-0201-4941-8bbf-b071b75c8403 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.153020 Sep 07 14:50:12.303250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 327/672] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:12 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:13.204761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:13.205296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:13.212368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:13.212853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:13.213290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:13.213976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:13.214430 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:13.214853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:13.325348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:13.325958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:13.332231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:13.332712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:13.333140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:13.333819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:13.334271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:13.334694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:13.340005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:13.348460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-23378849-bd67-4ab5-8b9e-4de009f167df tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.147430 Sep 07 14:50:13.349064 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 346/673] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:13 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:13.717228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:13.724999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-584e8c22-87a8-4c9e-b27b-4fdd45b6efc0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.403441 Sep 07 14:50:13.725888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 328/674] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:13 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:14.372843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:14.373453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:14.379810 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:14.380327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:14.380771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:14.381494 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:14.381915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:14.382344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:14.511471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:14.519767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36368493-001c-440f-b284-a0810c80cc3c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.151499 Sep 07 14:50:14.520357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 347/675] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:14 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:14.749958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:14.749958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:14.755438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:14.756029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:14.756716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:14.757639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:14.758517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:14.759647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:14.894970 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:14.902666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1a82d7a6-24a4-48fc-bb4d-911e4ed6fdec tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.159815 Sep 07 14:50:14.903227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 329/676] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:14 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:15.543169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:15.543812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:15.550491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:15.550975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:15.551521 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:15.552256 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:15.552714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:15.553140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:15.681648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:15.689959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1b55d681-aea1-47ed-9755-e385d2e10276 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.150649 Sep 07 14:50:15.690575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 348/677] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:15 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:15.925309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:15.925852 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:15.933093 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:15.933646 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:15.934090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:15.935106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:15.935743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:15.936213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:16.070335 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:16.078603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b47536f8-23de-4f62-9fdf-b1987ae4e1f0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.157319 Sep 07 14:50:16.079152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 330/678] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:15 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:16.713313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:16.713928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:16.715818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:16.716501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:16.721725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:16.722201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:16.722634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:16.723325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:16.723776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:16.724255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:16.858010 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:16.866297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3535495d-9e74-4898-881e-547c9e001e4f tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1736 microversion: 2.1 time: 0.157585 Sep 07 14:50:16.866869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 349/679] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:16 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1736 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:17.101017 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:17.101578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:17.103606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:17.108885 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:17.109361 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:17.109789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:17.110538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:17.111012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:17.111429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:17.243868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:17.251678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3a5eb413-75b1-41f3-8abd-1e4834a27779 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.154685 Sep 07 14:50:17.252255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 331/680] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:17 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:17.890699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:17.891223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:17.898203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:17.898937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:17.899929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:17.900887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:17.901180 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:17.901788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.042232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:18.051911 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a7ab2024-a3a9-4c64-a55f-509629fe79f2 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1716 microversion: 2.1 time: 0.165133 Sep 07 14:50:18.052865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 350/681] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:17 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1716 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:18.165836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:18.166360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:18.172800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.173278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.173712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.174396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.174847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.175318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.256282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] HTTP exception thrown: Cannot 'detach_volume' instance caf09108-7a72-4873-90be-3c0e907ab2a0 while it is in vm_state rescued Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Request method failure captured: Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments/7ff3f522-90c2-4541-a1f1-02870ea68cb2 HTTP/1.1 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6hSJxdBi6eEy6U9AQlNuLcma5FbEFn44tj3RQeLKfgEKdoowbpvTF_UVgUzE5NXQn2-y_elTJqTzevwbeUEK_CCealAstti6cpYWMHC_7Pyywly0rLWZcEZrBoCjwhepRwxzij_WunQhGHq4SBmj70yE600gbZNaSdoeBkSKHl7oQ Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:50:18.257879 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6869744faba14c0bb69be840cea600f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6869744faba14c0bb69be840cea600f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 9d8116d648d64a62af52d9db6a607e13 Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:50:18.259936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Cannot 'detach_volume' instance caf09108-7a72-4873-90be-3c0e907ab2a0 while it is in vm_state rescued Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'server_id': 'caf09108-7a72-4873-90be-3c0e907ab2a0', 'id': '7ff3f522-90c2-4541-a1f1-02870ea68cb2'} Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:50:18.260772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance caf09108-7a72-4873-90be-3c0e907ab2a0 while it is in vm_state rescued Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance caf09108-7a72-4873-90be-3c0e907ab2a0 while it is in vm_state rescued Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:18.262340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Returning 409 to user: Cannot 'detach_volume' instance caf09108-7a72-4873-90be-3c0e907ab2a0 while it is in vm_state rescued {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:50:18.263649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-82ccc053-f5bb-45fc-9577-5978f09f6c01 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments/7ff3f522-90c2-4541-a1f1-02870ea68cb2" status: 409 len: 152 microversion: 2.1 time: 0.098050 Sep 07 14:50:18.263649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 332/682] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:50:18 2022] DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments/7ff3f522-90c2-4541-a1f1-02870ea68cb2 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 07 14:50:18.268884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:18.269421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:18.274090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:18.275210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:18.277355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.277846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.278284 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.278981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.279438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.279892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.281906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.282365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.282797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.283480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.283934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.284389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.412556 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:18.420531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0cba7696-1e57-4e58-8c57-7a46363fd0b3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.150013 Sep 07 14:50:18.421485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 333/683] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:18 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:18.462081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-85c722b0-f9e7-45ac-bb96-d36a50b0c15a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/action" status: 202 len: 0 microversion: 2.1 time: 0.196900 Sep 07 14:50:18.462729 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 351/684] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:50:18 2022] POST /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:50:18.471517 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:18.472279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:18.478416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.479067 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.479601 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.480296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:18.480756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:18.481184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:18.620079 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:18.628539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8e108b27-5c7e-4348-83a6-52ce5578b64a tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1724 microversion: 2.1 time: 0.161602 Sep 07 14:50:18.629109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 334/685] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:18 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:19.444170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:19.444889 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:19.451569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:19.452052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:19.452520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:19.453209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:19.453666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:19.454091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:19.585027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:19.593588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4a982203-4b15-43d4-b1a7-b322b73e5c0b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.154335 Sep 07 14:50:19.594150 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 352/686] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:19 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:19.652571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:19.653183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:19.659616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:19.660099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:19.660571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:19.661264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:19.661720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:19.662150 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:19.789359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:19.797611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-62fcc389-2e83-403c-90ab-cb676b90e17d tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1724 microversion: 2.1 time: 0.149487 Sep 07 14:50:19.798175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 335/687] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:19 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:20.624775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:20.625321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:20.631776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:20.632272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:20.632757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:20.634109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:20.634576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:20.635050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:20.773571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:20.781824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ebeb4801-374a-4921-8fc4-a18502f6eef9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.160991 Sep 07 14:50:20.782396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 353/688] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:20 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:20.821947 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:20.822564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:20.829199 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:20.829690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:20.830131 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:20.830831 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:20.831287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:20.831715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:20.850788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:20.960201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:20.969002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-74d32ab2-4aa8-46cd-ba54-903862c65f95 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1724 microversion: 2.1 time: 0.151474 Sep 07 14:50:20.969565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 336/689] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:20 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:21.803797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:21.804511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:21.811651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:21.812135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:21.812602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:21.813296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:21.813759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:21.814189 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:21.949836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:21.957758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-21b95c8c-a7c1-4393-ae91-db97d173fb03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.157997 Sep 07 14:50:21.958316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 354/690] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:21 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:21.991749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:21.992481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:21.998960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:21.999443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:21.999884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.002304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.002304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.002304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.129768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:22.138478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0f98b17c-e8a7-44c6-8f0f-409c0f75d0ff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1730 microversion: 2.1 time: 0.150558 Sep 07 14:50:22.139028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 337/691] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:21 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:22.161711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:22.162140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:22.168082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.168624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.169061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.169753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.170205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.170651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.254432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8e222199-ae85-4d4a-875b-047c82672779 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096479 Sep 07 14:50:22.255027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 355/692] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:50:22 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:22.619034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:22.619526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:22.625467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.625950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.626381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.627078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.627528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.627951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.661179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ca430fd1-b175-4dd3-ba9f-419c2d8477a9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments/252e1fc0-d302-4664-b8f6-ae2aec1ae32a" status: 200 len: 194 microversion: 2.20 time: 0.046124 Sep 07 14:50:22.662344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 338/693] 10.222.0.57 () {60 vars in 1454 bytes} [Wed Sep 7 14:50:22 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments/252e1fc0-d302-4664-b8f6-ae2aec1ae32a => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:50:22.732549 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:22.733044 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:22.739261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.739756 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.740190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.741082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.741532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.742121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.834632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lazy-loading 'services' on Instance uuid ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:50:22.838272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:22.980620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:22.981231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:22.987260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.987748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.988210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:22.988904 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:22.989359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:22.989787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:23.034424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1823e506-daab-405c-8528-298533d8313d tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments/252e1fc0-d302-4664-b8f6-ae2aec1ae32a" status: 202 len: 0 microversion: 2.20 time: 0.305630 Sep 07 14:50:23.038807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 356/694] 10.222.0.57 () {60 vars in 1457 bytes} [Wed Sep 7 14:50:22 2022] DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments/252e1fc0-d302-4664-b8f6-ae2aec1ae32a => generated 0 bytes in 311 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:50:23.058588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:23.061767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:23.068448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:23.069127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:23.069740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:23.072364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:23.073000 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:23.075995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:23.106628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f65e4017-b738-4ed3-a913-e1af45d90ed4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.066339 Sep 07 14:50:23.108912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 357/695] 10.222.0.57 () {60 vars in 1343 bytes} [Wed Sep 7 14:50:23 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:50:23.208309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:23.217358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f6a152e3-8900-4435-90a2-865eb4435924 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.240588 Sep 07 14:50:23.218007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 339/696] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:22 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:23.312821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:23.322693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:23.323506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:23.324224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:23.336021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] Creating event network-changed:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:50:23.341354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-c2c701de-ff08-402f-93bf-d14d9b9acb1c req-627a22d4-efbe-4d82-a997-4c0912659919 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032224 Sep 07 14:50:23.342505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 358/697] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:24.119597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:24.121872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:24.128427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:24.128911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:24.131867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:24.131867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:24.131867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:24.131867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:24.167106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a404df6a-ef4e-4074-a713-2f0b95445328 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051316 Sep 07 14:50:24.167692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 340/698] 10.222.0.57 () {60 vars in 1343 bytes} [Wed Sep 7 14:50:24 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:50:24.242408 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:24.243093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:24.249659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:24.250134 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:24.250559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:24.251240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:24.251688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:24.252104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:24.388562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:24.396647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e17d7ba6-81ed-4f2e-a364-af3b5e65f18d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.158995 Sep 07 14:50:24.397209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 359/699] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:24 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:25.182394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:25.184726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:25.191084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.191566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.192001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.192747 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.193206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.193633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.223906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9e3eee6a-dcaf-4926-a05b-efcadb6e36a3 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047572 Sep 07 14:50:25.224801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 341/700] 10.222.0.57 () {60 vars in 1343 bytes} [Wed Sep 7 14:50:25 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:25.289719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:25.290262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:25.296996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.301886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.301886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.301886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.301886 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.302266 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.325145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:50:25.359994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:25.369783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.370246 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.370666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.381708 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] Creating event network-changed:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:50:25.387591 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-f4910923-1f08-4589-8b1b-f7880e09c375 req-066d7fc1-ac9d-4b0d-a77a-a66515510b5b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 Sep 07 14:50:25.388360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 342/701] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:50:25.420940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:25.421735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:25.428589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.429072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.429682 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.431167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.431840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.432481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.618546 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a587f4bd-1959-4bb7-acfb-2d18c6c7d85f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 204 len: 0 microversion: 2.20 time: 0.332489 Sep 07 14:50:25.619343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 360/702] 10.222.0.57 () {60 vars in 1280 bytes} [Wed Sep 7 14:50:25 2022] DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 14:50:25.628072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:25.628896 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:25.635992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.636632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.637137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.638171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:25.640617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:25.644891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:25.680641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:25.688699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d38da3eb-a1a6-47a8-91b3-6384198a3a32 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.272948 Sep 07 14:50:25.689256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 343/703] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:25 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:50:25.782566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:25.791008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:25.799281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:25.799281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-937254fa-7fd9-4de1-a5d7-ec010b90195a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.169774 Sep 07 14:50:25.799281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 361/704] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:25 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:26.710982 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:26.711523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:26.719326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:26.719814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:26.720331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:26.729592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:26.729592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:26.729592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:26.738834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e91d7cf-ac5c-47f0-9b62-c666ce07c34b", "name": "network-vif-plugged", "status": "completed", "tag": "bf8cc5d8-17e1-4be8-840a-eae77e5f2b80"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:26.750457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:26.750944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:26.751374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:26.763177 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] Creating event network-vif-plugged:bf8cc5d8-17e1-4be8-840a-eae77e5f2b80 for instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b on hv-cinder-80135 Sep 07 14:50:26.768087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-88b2722b-c933-46c5-8dd6-d5e0c121331c req-0c8e4dbf-30ca-452a-a588-16736710955d service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033720 Sep 07 14:50:26.768989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 362/705] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:26.824065 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:26.824965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:26.840280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:26.840877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:26.841418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:26.842353 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:26.843005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:26.843630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:26.862874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:26.880616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f7bb0424-cc6f-4423-ac8e-90d9d3c90d58 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.173472 Sep 07 14:50:26.881218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 344/706] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:26 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:26.996967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:27.005125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:27.006571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:27.007713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-61d8d646-ebef-4f87-99de-022235c77765 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.192577 Sep 07 14:50:27.008278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 363/707] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:26 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:27.904344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:27.904939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:27.912191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:27.912897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:27.913725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:27.914574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:27.915024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:27.915445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:28.034516 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:28.035253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:28.042326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:28.042866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:28.043298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:28.044075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:28.044558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:28.045002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:28.168623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:28.178897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-059804be-fc25-4615-a296-2536fb94bd3f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.278886 Sep 07 14:50:28.180110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 345/708] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:27 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:28.263718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:28.272513 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:28.273931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:28.275068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cb778953-e35d-4198-a1cf-58683d526d47 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1724 microversion: 2.20 time: 0.245456 Sep 07 14:50:28.275883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 364/709] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:28 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1724 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:28.964466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d", "name": "network-vif-deleted", "tag": "b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:28.975618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:28.978994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:28.979880 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:28.991872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] Creating event network-vif-deleted:b9b09047-42fc-4fd4-a9a5-aa87f3f0f2f9 for instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d on hv-cinder-80135 Sep 07 14:50:28.997604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-23b1084d-28c2-470f-91b2-fb30f12c5ee7 req-dc6cb450-cef4-4d66-a3da-c459debe7286 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036731 Sep 07 14:50:28.998057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 346/710] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:50:29.206052 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:29.206704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:29.213290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:29.213774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:29.214205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:29.214931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:29.215425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:29.216117 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:29.302567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:29.303433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:29.327157 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:29.328311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:29.329248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:29.330051 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:29.330510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:29.331267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:29.388845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:29.397247 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-42efeb99-7468-48cb-8cfd-6d9b61276c08 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1266 microversion: 2.1 time: 0.195183 Sep 07 14:50:29.412193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 365/711] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:29 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1266 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:29.463999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:29.481667 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:29.489105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:29.489105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2b337444-9fd0-4627-a807-891d3ae8df6b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1656 microversion: 2.20 time: 0.187718 Sep 07 14:50:29.497512 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 347/712] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:29 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1656 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:30.419015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:30.419751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:30.427784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.428486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.429185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.430094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.430625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.431141 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.525666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:30.527001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:30.534491 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.535091 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.536881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.539362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.539941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.540526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.575421 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.576828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.577422 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.578023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lazy-loading 'fault' on Instance uuid ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:50:30.650107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:30.660321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:30.663803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:30.666248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e97585a6-9b9f-4d35-bf0b-a142c4397ed9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 200 len: 1370 microversion: 2.20 time: 0.143895 Sep 07 14:50:30.667168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 348/713] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:30 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 1370 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:30.716970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:30.727127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3b4b7549-1093-4bd6-a384-875f35f59866 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1453 microversion: 2.1 time: 0.312015 Sep 07 14:50:30.727913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 366/714] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:30 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1453 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:30.752734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:30.753315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:30.761534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.768110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.768110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.768110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:30.768110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:30.768765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:30.898882 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:30.908309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b44051d2-7728-446f-a1d4-31c473d1385d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1453 microversion: 2.1 time: 0.159666 Sep 07 14:50:30.908892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 349/715] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:30 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1453 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:31.699506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:31.700123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:31.709428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:31.709928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:31.710389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:31.711827 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:31.712451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:31.713514 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:31.729154 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d HTTP/1.1 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:50:31.731176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:50:31.737041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d'} Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:50:31.737840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:50:31.739095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:31.740267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:50:31.740267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c16afef5-5e41-4fca-9582-7f6533accb1c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 404 len: 111 microversion: 2.20 time: 0.037566 Sep 07 14:50:31.740267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 367/716] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:31 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:50:31.742000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-860826c4-8e46-4412-9bc0-15d0c4fb988e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '.version_select at 0x7fefdf90bc10>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:31.819240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-860826c4-8e46-4412-9bc0-15d0c4fb988e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-404559129" status: 204 len: 0 microversion: 2.20 time: 0.081113 Sep 07 14:50:31.819817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 350/717] 10.222.0.57 () {60 vars in 1259 bytes} [Wed Sep 7 14:50:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-404559129 => generated 0 bytes in 82 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 14:50:32.885213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-666f6403-9079-466a-9612-2114809015e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: .version_select at 0x7fefdf806af0>, body: {"keypair": {"name": "tempest-keypair-1332131323", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDUrHxwK4kykrRvTuc+8Qx8IzEi7xE6byKHGhliSoDndmzDvQQ4Y+Rme6GJMpHdJypDntIpfzUaVElPObJ/GYqOCJ7ZBLDC/T+VipNn2PrXadoZ5bYOEIIPSLsN6rQ1LYQ=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:32.907181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-666f6403-9079-466a-9612-2114809015e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for project fa5b6b66febc4070a509feee0b0838f6. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:50:32.912989 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-666f6403-9079-466a-9612-2114809015e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for user eeab924bf7a646779b48f57f14710e05 and project fa5b6b66febc4070a509feee0b0838f6. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:50:33.020943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-666f6403-9079-466a-9612-2114809015e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.139942 Sep 07 14:50:33.022887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 368/718] 10.222.0.57 () {62 vars in 1200 bytes} [Wed Sep 7 14:50:32 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 143 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 07 14:50:33.997777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9e91d7cf-ac5c-47f0-9b62-c666ce07c34b", "tag": "bf8cc5d8-17e1-4be8-840a-eae77e5f2b80"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:34.009615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=71,nova_api:DELETE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:34.012319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:34.012319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:34.012319 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:34.050892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] Creating event network-changed:bf8cc5d8-17e1-4be8-840a-eae77e5f2b80 for instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b on hv-cinder-80135 Sep 07 14:50:34.054099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-4f1f15e8-5237-444f-8df7-18f7ea989e37 req-be1657e5-9665-416b-be4a-77e9238939a1 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060884 Sep 07 14:50:34.055328 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 351/719] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:36.581121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1716393426", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6b485272-8a19-4d1f-a2de-9c7c48b3c305"}], "security_groups": [{"name": "tempest-securitygroup--219860754"}], "key_name": "tempest-keypair-1332131323", "user_data": "}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:36.717835 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] validate_networks() for [('6b485272-8a19-4d1f-a2de-9c7c48b3c305', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:50:37.194939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:50:37.195459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:50:37.195955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:50:37.196436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:50:37.196885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:50:37.206417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:37.206909 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:37.207376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:37.208323 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:37.208784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:37.209213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:37.226240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for project fa5b6b66febc4070a509feee0b0838f6. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:50:37.230463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Getting quotas for user eeab924bf7a646779b48f57f14710e05 and project fa5b6b66febc4070a509feee0b0838f6. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:50:37.242432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:50:37.245346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:50:37.436798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d7e14161-2a34-4e34-b568-7ec2758e5ee4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.860579 Sep 07 14:50:37.442566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 369/720] 10.222.0.57 () {62 vars in 1188 bytes} [Wed Sep 7 14:50:36 2022] POST /compute/v2.1/servers => generated 401 bytes in 867 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 07 14:50:37.453255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:37.454021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:37.533194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:37.541799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:37.543231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:37.547058 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d4d60101-ceef-48ad-b0fc-006f6cd6657b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1282 microversion: 2.20 time: 0.098703 Sep 07 14:50:37.557661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 352/721] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:37 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1282 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:37.637575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:37.638652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:37.646109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:37.648941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:37.648941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:37.648941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:37.648941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:37.651740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:37.695820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-effafe56-5d44-480e-8c1e-0ca08502a73a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/ips" status: 200 len: 150 microversion: 2.1 time: 0.063159 Sep 07 14:50:37.703848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 370/722] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:50:37 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/ips => generated 150 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:38.575100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:38.576036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:38.589398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:38.589398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:38.589398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:38.589398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:38.591435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:38.592067 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:38.685412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:38.693998 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:38.695459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:38.696595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-024496e9-1619-4404-8efa-0ae5b50d25d6 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1286 microversion: 2.20 time: 0.126222 Sep 07 14:50:38.697778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 353/723] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:38 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1286 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:39.486208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "252e4279-6b7b-4db0-8e8d-7511ba4a4afd"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:39.488759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:39.495617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:39.496314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:39.496903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:39.497610 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:39.498075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:39.498495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:39.728473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:39.728473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:39.730475 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:39.731032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:39.731704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:39.732497 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:39.733155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:39.733856 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:39.833520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:39.845468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:39.849382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:39.851966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-28b6b4b4-104a-45b3-a84c-2ad1360b6e90 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1334 microversion: 2.20 time: 0.133118 Sep 07 14:50:39.855192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 354/724] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:39 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1334 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:40.612004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-66db5acf-21a6-4553-a631-5e6e6e818106 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.129486 Sep 07 14:50:40.614042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 371/725] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:50:39 2022] POST /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments => generated 194 bytes in 1133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:40.881090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:40.882346 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:40.889236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:40.889735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:40.890208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:40.896925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:40.896925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:40.896925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:40.991279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:41.003021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:41.005053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:41.011446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9f0876ec-c259-4390-863a-fc1d20bf449c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1340 microversion: 2.20 time: 0.130006 Sep 07 14:50:41.012619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 355/726] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:40 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1340 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:42.043708 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:42.045714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:42.048624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=85,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:42.054068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:42.054755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:42.055348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:42.056461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:42.057255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:42.057831 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:42.372764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:42.384029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:42.385968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:42.387346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cf1215c9-c9a7-451a-a937-517ababef41c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.349681 Sep 07 14:50:42.388269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 372/727] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:42 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:42.406988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-256fd1f6-df0c-485f-8317-52e3d2d209be tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Action: 'create', calling method: .version_select at 0x7fefdf90b430>, body: {"keypair": {"name": "tempest-TestShelveInstance-1633278026", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNeOo84Lsk/X/8cbo6SmmcOaNcKhrA8no9mLbUroaGhcjCDG5HMFbStIYFYRdBYUTLSQuVdl85yarKe3PhbjLBWbjIJviAqeVwcdufKgaGwIbDi7ouvtZ9hHyyNP9yd81Q=="}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:42.423970 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-256fd1f6-df0c-485f-8317-52e3d2d209be tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Getting quotas for project 6bc6eee4ac194763a27bb87522d47c6c. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:50:42.427961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-256fd1f6-df0c-485f-8317-52e3d2d209be tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Getting quotas for user 2d34e301934743d5a457ae7fd979a53f and project 6bc6eee4ac194763a27bb87522d47c6c. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:50:42.503956 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-256fd1f6-df0c-485f-8317-52e3d2d209be tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.299189 Sep 07 14:50:42.505052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 356/728] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:50:42 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:50:42.611851 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:42.628974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:42.629863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:42.630301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:42.642677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] Creating event network-changed:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:50:42.647983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-b3db4e22-b881-4567-ab2e-3f073c81c67d req-20a205a9-09fb-4b75-9a81-8947c259cfe0 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039672 Sep 07 14:50:42.648957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 373/729] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:43.414024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:43.414659 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:43.422240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:43.422726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:43.423151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:43.423839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:43.424317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:43.424740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:43.554922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:43.559239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:43.564508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:43.565679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:43.570104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2ef16cf5-77d3-434b-b61e-da967b3f1f6f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.157173 Sep 07 14:50:43.570104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 357/730] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:43 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:44.593033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:44.593726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:44.600185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:44.600665 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:44.601098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:44.604753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:44.604753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:44.604753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:44.814334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:44.818113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:44.823468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:44.824913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:44.826019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8251e3a9-18df-4e21-a7cc-7ddae35e3e15 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.238575 Sep 07 14:50:44.826569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 374/731] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:44 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:45.851068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:45.851671 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:45.859345 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:45.859828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:45.860344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:45.864881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:45.864881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:45.864881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:45.997272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:46.005468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:46.006889 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:46.007991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f3b57ca8-7fd4-4815-a55d-eb298499adc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.160785 Sep 07 14:50:46.008588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 358/732] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:45 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:47.033468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:47.034084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:47.045213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:47.047855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:47.052867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:47.052867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:47.052867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:47.052867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:47.203485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:47.212217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:47.214380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:47.215747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-657331f6-20dd-43e2-ab01-4e7990dac162 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.186178 Sep 07 14:50:47.218462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 375/733] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:47 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:48.241928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:48.242555 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:48.252351 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.252850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.253289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.254064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.254542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.255137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.411851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:48.421216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:48.424469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:48.424469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-567dc307-37b5-467e-9b58-e1bb717ed885 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.185859 Sep 07 14:50:48.425827 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 359/734] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:48 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:48.529658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "252e4279-6b7b-4db0-8e8d-7511ba4a4afd"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:48.532820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:48.537948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:48.539304 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=10 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:48.543286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.543776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.544237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.544947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.545401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.545827 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.641172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: POST /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments HTTP/1.1 Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 74 Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:50:48.643072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {"volumeAttachment": {"volumeId": "252e4279-6b7b-4db0-8e8d-7511ba4a4afd"}} Sep 07 14:50:48.644770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'server_id': 'c5ae47dd-c46e-4a26-9a32-b659fdebd24a', 'body': {'volumeAttachment': {'volumeId': '252e4279-6b7b-4db0-8e8d-7511ba4a4afd'}}} Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:48.649527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:48.651501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 400 to user: Invalid volume: volume 252e4279-6b7b-4db0-8e8d-7511ba4a4afd is already attached to instances: c5ae47dd-c46e-4a26-9a32-b659fdebd24a {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-05d3a25f-2d03-48af-8c3d-68ad60d67068 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.120601 Sep 07 14:50:48.652943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 376/735] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:50:48 2022] POST /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments => generated 174 bytes in 122 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:50:48.725171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:48.725980 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:48.732655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.733153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.733590 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.734300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:48.734753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:48.735207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:48.825234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'services' on Instance uuid c5ae47dd-c46e-4a26-9a32-b659fdebd24a {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:50:49.012028 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "name": "network-vif-plugged", "status": "completed", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:49.039873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:49.039873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:49.039873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:49.049464 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] Creating event network-vif-plugged:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:50:49.054613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-3592927d-c0a9-43e2-a5ad-f322ae380b75 req-094c6956-9351-457f-8d20-caee3899f0fe service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.053669 Sep 07 14:50:49.055211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 377/736] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:49.068361 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-972a2869-6270-457b-917d-c91cb2f957d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments/252e4279-6b7b-4db0-8e8d-7511ba4a4afd" status: 202 len: 0 microversion: 2.1 time: 0.347569 Sep 07 14:50:49.069629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 360/737] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:50:48 2022] DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments/252e4279-6b7b-4db0-8e8d-7511ba4a4afd => generated 0 bytes in 350 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:50:49.079064 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:49.081726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:49.090156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:49.091283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:49.092036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:49.092899 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:49.093604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:49.094132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:49.136805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1f9cf139-0c36-4024-9a88-0510f5a6b1d3 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062023 Sep 07 14:50:49.142255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 378/738] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:50:49 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:50:49.500961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:49.501850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:49.509543 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:49.510050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:49.510490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:49.511195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:49.511649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:49.512073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:49.676896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:49.687598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:49.689068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:49.690177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c540359e-9376-4b25-91bf-2a13784fdd19 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.245903 Sep 07 14:50:49.690734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 361/739] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:49 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:50.150843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:50.152993 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:50.159436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:50.159915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:50.160402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:50.161110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:50.161569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:50.162016 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:50.192994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c2f422d4-6aae-41de-a903-5d9dde287e55 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046781 Sep 07 14:50:50.193563 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 379/740] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:50:50 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:50.718480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:50.719203 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:50.726141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:50.730837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:50.730837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:50.730837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:50.730837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:50.731809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:50.865375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:50.873750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:50.875174 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:50.876304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9279286b-51fa-40b4-8288-e8bc0066a6cd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1407 microversion: 2.20 time: 0.161894 Sep 07 14:50:50.876860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 362/741] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:50 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:50:51.205643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:51.207818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:51.214835 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.215317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.215755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.216481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.216940 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.217368 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.247507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bf1f679d-13b1-4370-830a-efb54e057108 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045742 Sep 07 14:50:51.248121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 380/742] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:50:51 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:50:51.313088 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:51.313578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:51.319508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.319977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.320472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.321167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.321595 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.322012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.348443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:50:51.688755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9cd45252-6390-4fac-884a-5f8ef974db74 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 204 len: 0 microversion: 2.1 time: 0.378719 Sep 07 14:50:51.689442 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 363/743] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:50:51 2022] DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 0 bytes in 381 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:50:51.697762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:51.698402 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:51.704881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.705366 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.705794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.706488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.706941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.707359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.902123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:51.903046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:51.910450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.910945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.911388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.912092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:51.912612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:51.913038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:51.945765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:51.954334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-96b1838c-6d01-43b0-9ff5-2763fd6173d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1683 microversion: 2.1 time: 0.260367 Sep 07 14:50:51.955225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 381/744] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:51 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1683 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:52.050674 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:52.058781 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:52.060240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:52.061385 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d406707f-24fe-4630-82c2-62cf6b0ab678 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1599 microversion: 2.20 time: 0.163806 Sep 07 14:50:52.061937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 364/745] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:50:51 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1599 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:50:52.086376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:52.086871 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:52.093581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:52.094068 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:52.094507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:52.095217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:52.095649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:52.096069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:52.174370 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-efcb3c23-8771-4acf-b839-dab17cbe8139 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.091944 Sep 07 14:50:52.175046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 382/746] 10.222.0.57 () {60 vars in 1316 bytes} [Wed Sep 7 14:50:52 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:50:52.981943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:52.982547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:52.985493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=6 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:50:52.992316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:52.992854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:52.993290 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:52.993993 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:52.994447 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:52.994874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:53.225563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:53.235204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eca19b33-0308-45d2-a16e-026102032092 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1683 microversion: 2.1 time: 0.258848 Sep 07 14:50:53.235854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 365/747] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:52 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1683 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:53.534018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:53.543937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:53.544445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:53.544883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:53.556813 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] Creating event network-changed:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:50:53.562246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-e7333d44-0d3c-4c8b-9bc3-2a94d356ce30 req-1e78cd93-fbac-4ffa-bdb2-32b8d73f9b50 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032353 Sep 07 14:50:53.563240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 383/748] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:54.270652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:54.272072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:54.281596 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:54.282105 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:54.282523 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:54.287562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:54.288066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:54.289939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:54.494694 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:54.503177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2833bd30-e85d-4757-8478-eee7154474b0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1615 microversion: 2.1 time: 0.247336 Sep 07 14:50:54.519661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 366/749] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:54 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1615 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:55.530101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:55.531941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:55.539360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:55.539872 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:55.540355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:55.541259 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:55.541706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:55.550707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:55.583168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c5ae47dd-c46e-4a26-9a32-b659fdebd24a", "name": "network-vif-deleted", "tag": "f68a3148-532c-480e-bebd-47d13cbdfa96"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:55.592955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:55.593515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:55.594041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:55.594571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:55.595061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:55.595493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:55.595951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid c5ae47dd-c46e-4a26-9a32-b659fdebd24a {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:50:55.612959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] Creating event network-vif-deleted:f68a3148-532c-480e-bebd-47d13cbdfa96 for instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a on hv-cinder-80135 Sep 07 14:50:55.618253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-e0bb314d-c579-4704-817d-4f6b9f38c3ad req-11e3f219-6392-472e-ac8a-53a96eea3341 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041205 Sep 07 14:50:55.619168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 367/750] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:50:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:55.649816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:50:55.657963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b904b85c-a11d-4ddc-b212-144052b9021c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 200 len: 1332 microversion: 2.1 time: 0.134754 Sep 07 14:50:55.658520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 384/751] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:55 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 1332 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:50:56.687151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:56.687855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:50:56.694190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:56.694677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:56.695101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:56.695790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:50:56.696374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:50:56.696684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:50:56.710115 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a HTTP/1.1 Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:50:56.711703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:50:56.713630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'c5ae47dd-c46e-4a26-9a32-b659fdebd24a'} Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:50:56.714800 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:50:56.717033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:50:56.718503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:50:56.718503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d9188066-97b1-4055-aff3-b0e1f8dea329 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 404 len: 111 microversion: 2.1 time: 0.030782 Sep 07 14:50:56.718503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 368/752] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:50:56 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:50:56.723053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e5000953-cb3a-4d66-990a-67e14869d1e2 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '.version_select at 0x7fefdf7ab670>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:50:56.830862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e5000953-cb3a-4d66-990a-67e14869d1e2 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617433422" status: 202 len: 0 microversion: 2.1 time: 0.111561 Sep 07 14:50:56.831468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 385/753] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:50:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1617433422 => generated 0 bytes in 113 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:50:57.574834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-51f3a4a0-756e-4674-8712-c5a76a0d5913 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: .version_select at 0x7fefdf8b1790>, body: {"keypair": {"name": "tempest-keypair-1321472239", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJxQjMnyIi9Fv9k1knz92l5AQpkE1cjRh8cnWT9XbxydV1u7018ZeKrwntL0hTaa7lyC8zTa0mivH5xoJVa+N689BV4zc79tc5hK9au9z0UZ79XG4axOSqj4wzH9/T3EAw=="}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:57.580415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:50:57.580572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Wed Sep 7 14:50:57 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.57) !!! Sep 07 14:50:57.593445 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-51f3a4a0-756e-4674-8712-c5a76a0d5913 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:50:57.598042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-51f3a4a0-756e-4674-8712-c5a76a0d5913 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:50:57.693284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-51f3a4a0-756e-4674-8712-c5a76a0d5913 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.122345 Sep 07 14:50:57.693965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 369/754] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:50:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:50:59.745423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1493206812", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "163090f4-fd08-48b4-a9ef-0baf5dc14d96"}], "security_groups": [{"name": "tempest-securitygroup--1813942525"}], "key_name": "tempest-keypair-1321472239", "user_data": "}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:50:59.848072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] validate_networks() for [('163090f4-fd08-48b4-a9ef-0baf5dc14d96', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:51:00.248460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:51:00.248882 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:51:00.249358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:51:00.249764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:51:00.250174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:51:00.258853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:00.259330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:00.259761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:00.260518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:00.260970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:00.261391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:00.277867 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:51:00.282355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Getting quotas for user 8eb5509df78d45acbebc332a889251dc and project e03d56845a594ecf9c320b2d70a633ca. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:51:00.293477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:51:00.296448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:51:00.430854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f719ad1c-8e32-4ed5-b9dc-d6a789218ce4 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.690144 Sep 07 14:51:00.431887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 386/755] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:50:59 2022] POST /compute/v2.1/servers => generated 402 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:51:00.442652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0d15c400-49ef-48b5-b69a-6e98231e9003 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:00.447752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0d15c400-49ef-48b5-b69a-6e98231e9003 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:00.498103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0d15c400-49ef-48b5-b69a-6e98231e9003 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:00.504965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0d15c400-49ef-48b5-b69a-6e98231e9003 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1242 microversion: 2.1 time: 0.066161 Sep 07 14:51:00.505522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 370/756] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:00 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:01.529460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:01.530155 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:01.536927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:01.537413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:01.537852 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:01.538545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:01.539002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:01.539430 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:01.605059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:01.613339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f477d236-8cea-4486-a52e-2db4bda91cdc tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1246 microversion: 2.1 time: 0.090280 Sep 07 14:51:01.613916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 387/757] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:01 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1246 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:02.636341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:02.636964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:02.646524 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:02.647018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:02.647448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:02.648173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:02.648638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:02.649076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:02.733850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:02.742136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-97e12b4f-51d3-4cbe-bd71-ad215de57c8d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1294 microversion: 2.1 time: 0.109692 Sep 07 14:51:02.752207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 371/758] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:02 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1294 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:02.814147 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-805193524", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1633278026", "security_groups": [{"name": "tempest-secgroup-smoke-304082040"}], "networks": [{"uuid": "4504b923-702e-46f6-a2cb-86e337cf7b55"}], "block_device_mapping_v2": [{"uuid": "4c4b3dba-cd11-41d3-9ea0-dc3a7a6d34aa", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:02.996877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] validate_networks() for [('4504b923-702e-46f6-a2cb-86e337cf7b55', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:51:03.765895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:03.766623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:03.773597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:03.774082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:03.774518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:03.775217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:03.775668 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:03.776095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:03.850897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:51:03.851377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:51:03.851927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:51:03.852476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:51:03.853109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:51:03.855394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:03.862507 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:03.863013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:03.863623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:03.863758 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-116414d0-dff8-4b6d-ba8f-934dcc5892aa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1300 microversion: 2.1 time: 0.102303 Sep 07 14:51:03.864297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 372/759] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:03 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1300 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:03.864864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:03.865558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:03.865988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:03.883053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Getting quotas for project 6bc6eee4ac194763a27bb87522d47c6c. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:51:03.886833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Getting quotas for user 2d34e301934743d5a457ae7fd979a53f and project 6bc6eee4ac194763a27bb87522d47c6c. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:51:03.943576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:51:03.945650 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4c4b3dba-cd11-41d3-9ea0-dc3a7a6d34aa',volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:51:04.340577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-18e248ea-c420-438b-83bc-56be727634d0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.530079 Sep 07 14:51:04.341437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 388/760] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:51:02 2022] POST /compute/v2.1/servers => generated 405 bytes in 1532 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:51:04.352347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-15c0c1bf-d195-4207-be7f-1c116e5d4781 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:04.353064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-15c0c1bf-d195-4207-be7f-1c116e5d4781 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:04.429773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-15c0c1bf-d195-4207-be7f-1c116e5d4781 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:04.443118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-15c0c1bf-d195-4207-be7f-1c116e5d4781 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1088 microversion: 2.1 time: 0.094501 Sep 07 14:51:04.443764 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 373/761] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:04 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1088 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:04.580039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:04.580569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:04.586790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.595058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.595058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.595058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.595058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.595446 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.672680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'services' on Instance uuid caf09108-7a72-4873-90be-3c0e907ab2a0 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:51:04.887378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:04.887771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:04.895018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.895602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.902007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.905221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.905221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.905645 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.907878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-568f8685-7a59-4e4e-af3a-009111e61bbe tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments/7ff3f522-90c2-4541-a1f1-02870ea68cb2" status: 202 len: 0 microversion: 2.1 time: 0.328316 Sep 07 14:51:04.908637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 389/762] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:51:04 2022] DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments/7ff3f522-90c2-4541-a1f1-02870ea68cb2 => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:51:04.928564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:04.932307 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:04.940246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.940842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.941345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.942070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:04.942526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:04.942944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:04.975170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c131b4bf-4034-4755-90d1-2bd66b989db9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052631 Sep 07 14:51:04.976086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 390/763] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:51:04 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:05.031988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34293389-a94e-4532-ae7c-470650739524", "tag": "df5252c5-6e82-460c-b2a6-d9aa0ddefac1"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:05.042807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:05.043404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:05.045003 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:05.058424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] Creating event network-changed:df5252c5-6e82-460c-b2a6-d9aa0ddefac1 for instance 34293389-a94e-4532-ae7c-470650739524 on hv-cinder-80135 Sep 07 14:51:05.063232 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-ff736b31-eeaf-4728-af80-5c574c3ca2bc req-7ba8a9ea-c70e-43e5-82f1-86fa8a359e54 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035861 Sep 07 14:51:05.063818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 391/764] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:05.123617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:05.132097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bb2576d1-adca-4f72-bf97-9b3da4d14dda tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.249060 Sep 07 14:51:05.133007 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 374/765] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:04 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:05.466287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:05.467063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:05.473893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:05.474382 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:05.474815 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:05.475653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:05.476115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:05.476647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:05.545053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:05.553345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-058e44f8-c725-4ced-8b64-d72949b0978a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1138 microversion: 2.1 time: 0.091451 Sep 07 14:51:05.554176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 392/766] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:05 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:05.987981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:05.990546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:05.997279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:05.997760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:05.998197 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:05.998968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:05.999452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:05.999882 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:06.031768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e4ac077f-68ca-4b94-8b02-87c107a41a53 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047703 Sep 07 14:51:06.032673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 375/767] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:51:05 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:06.157734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:06.158458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:06.164915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:06.165391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:06.165817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:06.166499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:06.166946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:06.167374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:06.299440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:06.307084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-33122eb0-16e9-4c1e-8c60-2f5eaf1d1f19 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.153214 Sep 07 14:51:06.307654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 393/768] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:06 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:06.577653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:06.578186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:06.584083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:06.584594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:06.585023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:06.585701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:06.586173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:06.586588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:06.605726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:06.648208 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:06.656357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9a0f2170-acbe-48ed-bbd2-5718ac624212 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1186 microversion: 2.1 time: 0.083021 Sep 07 14:51:06.656911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 376/769] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:06 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1186 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:07.044583 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:07.046879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:07.052878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.053371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.053809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.054501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.054960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.055386 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.084208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5b66e73b-3c47-4e5c-9755-5cbb2ddfc4f9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043645 Sep 07 14:51:07.084761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 394/770] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:51:07 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:51:07.165435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:07.165925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:07.173118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.173609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.174052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.174753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.175218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.175647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.201845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:51:07.329127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:07.329749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:07.336799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.337279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.337727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.338392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.338842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.339256 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.343941 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:07.470213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:07.477803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0536bdae-772c-4413-a514-8a71596dd7d8 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.152470 Sep 07 14:51:07.478364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 395/771] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:07 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:07.492258 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ca7754d9-2ee0-4c9b-b662-29e58cdd1423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 204 len: 0 microversion: 2.1 time: 0.330331 Sep 07 14:51:07.492792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 377/772] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:51:07 2022] DELETE /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:51:07.500454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:07.506029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:07.507415 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.507900 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.508377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.509083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.509524 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.509953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.642511 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:07.650627 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f253342a-7f80-4f5f-9d7a-166ada5a1e35 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1690 microversion: 2.1 time: 0.153874 Sep 07 14:51:07.651204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 396/773] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:07 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1690 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:07.679297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:07.679991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:07.685989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.686467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.686892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.687572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:07.688019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:07.688462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:07.754459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:07.762462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b45aa6f5-88e7-43c0-8a2e-7d975ea047eb tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1186 microversion: 2.1 time: 0.087348 Sep 07 14:51:07.763024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 378/774] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:07 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1186 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:08.501440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:08.502018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:08.508519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.509002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.509438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.510130 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.515843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.515843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.643083 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:08.650994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0d8eb41e-d7ab-402d-bbf1-58938f74ec12 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.154175 Sep 07 14:51:08.651557 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 397/775] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:08 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:08.674092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:08.678844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:08.678844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=2,nova_api:UPDATE=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:08.682223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.682712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.683142 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.683930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.684922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.685349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.786143 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:08.788220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:08.793246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.794344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.794862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.795635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:08.796182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:08.796824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:08.823549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:08.832238 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-17771385-fce9-4c73-b1f6-16bf065a69ec tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1690 microversion: 2.1 time: 0.161893 Sep 07 14:51:08.833448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 379/776] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:08 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1690 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:08.860470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:08.868174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-85d213b9-dfdd-496b-a93b-f69b68740c85 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1194 microversion: 2.1 time: 0.085830 Sep 07 14:51:08.868750 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 398/777] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:08 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1194 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:09.674285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:09.674895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:09.680951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.681425 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.681851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.682930 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.683028 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.683395 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.819283 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:09.827209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bc65e0db-46da-4bad-8a3a-c03a26a0cb4b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.157589 Sep 07 14:51:09.827771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 380/778] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:09 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:09.855792 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:09.857174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:09.863499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.863970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.864422 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.865094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.865534 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.865946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.892869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:09.893477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:09.899653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.900137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.900597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.901283 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:09.901734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:09.902156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:09.974858 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:09.983209 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-65ec9e48-e1cd-4423-b494-6b1e363e2e03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1194 microversion: 2.1 time: 0.094121 Sep 07 14:51:09.983801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 381/779] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:09 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1194 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:10.014918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:10.022826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-20c9c442-2e9a-4f7f-a626-d35cfbcdfe60 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1690 microversion: 2.1 time: 0.170786 Sep 07 14:51:10.023377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 399/780] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:09 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1690 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:10.849825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:10.850426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:10.856821 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:10.857297 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:10.857728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:10.858416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:10.858891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:10.859310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:10.923295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34293389-a94e-4532-ae7c-470650739524", "name": "network-vif-plugged", "status": "completed", "tag": "df5252c5-6e82-460c-b2a6-d9aa0ddefac1"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:10.931884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:10.932540 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:10.932962 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:10.944777 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] Creating event network-vif-plugged:df5252c5-6e82-460c-b2a6-d9aa0ddefac1 for instance 34293389-a94e-4532-ae7c-470650739524 on hv-cinder-80135 Sep 07 14:51:10.950467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-09e7b454-6801-46ec-bd0b-682f81e9b9e7 req-9126463d-389a-406a-9658-b0bcfc491af9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032178 Sep 07 14:51:10.950796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 400/781] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:51:10.998432 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:11.006643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-32122c03-807e-42dd-b8d4-69d4108bcb24 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.160523 Sep 07 14:51:11.007497 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 382/782] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:10 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:11.007621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:11.008256 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:11.015915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:11.016854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:11.017560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:11.018046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:11.018505 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:11.018925 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:11.047855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:11.048977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:11.058185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:11.058831 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:11.060169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:11.061000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:11.061572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:11.062302 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:11.121097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:11.129684 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5f50bab0-2509-4885-842d-da992fa411ae tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1194 microversion: 2.1 time: 0.127115 Sep 07 14:51:11.130477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 401/783] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:11 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1194 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:11.288503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:11.296969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e5df851c-133e-4381-97ad-6316ac241d31 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1690 microversion: 2.1 time: 0.254058 Sep 07 14:51:11.297540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 383/784] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:11 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1690 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:12.031614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:12.032255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:12.039648 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.040607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.041162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.042033 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.042645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.043397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.152665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:12.154416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:12.161329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.161818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.162251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.162948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.163393 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.163881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.225300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:12.233564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e16f7e49-06eb-4a13-aeff-7fff95048651 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.206908 Sep 07 14:51:12.234225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 402/785] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:12 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:12.321908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:12.322726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:12.328696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:12.335997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.338559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.339214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.341856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.342340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.342785 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.350555 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7a5c1cf3-bb2e-451f-aaac-42f57ba934c4 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1271 microversion: 2.1 time: 0.201661 Sep 07 14:51:12.354924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 384/786] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:12 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1271 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:12.440339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:12.466290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-56cadd0b-d452-4b6d-836f-6144d3a082e8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1622 microversion: 2.1 time: 0.148557 Sep 07 14:51:12.470635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 403/787] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:12 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1622 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:12.720478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "caf09108-7a72-4873-90be-3c0e907ab2a0", "name": "network-vif-deleted", "tag": "3d68de22-d979-4a5f-af67-fe1bf69bfa4d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:12.730563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:12.731096 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:12.731787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:12.744283 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] Creating event network-vif-deleted:3d68de22-d979-4a5f-af67-fe1bf69bfa4d for instance caf09108-7a72-4873-90be-3c0e907ab2a0 on hv-cinder-80135 Sep 07 14:51:12.749596 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-2d9e2f03-4825-49ad-8e64-eacbc53a81a7 req-d2b618f8-a1cc-4dc9-bdcf-9d758cb2b34e service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096493 Sep 07 14:51:12.750188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 385/788] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:13.258317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:13.259152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:13.270910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.271579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.273763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.282201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.282695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.283134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.312281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:13.317446 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=93,nova_api:DELETE=1,nova_api:INSERT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:13.323037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.323510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.324022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.339566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] Creating event network-changed:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:51:13.344647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-3b589147-d507-44dd-80d3-23dadff164a1 req-3a42d68d-c441-4511-8220-360098914f6f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142924 Sep 07 14:51:13.345319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 404/789] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:51:13.380467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:13.381710 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:13.388301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.388951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.389461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.390241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.390771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.391271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.520574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:13.529498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0c668715-eb5d-4510-b761-1a3a5297658d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1368 microversion: 2.1 time: 0.274945 Sep 07 14:51:13.530724 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 386/790] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:13 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1368 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:13.536194 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:13.537119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:13.544547 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.545041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.545496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.546216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.546672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.547100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.598326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:13.598326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:13.598326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:13.598326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'fault' on Instance uuid caf09108-7a72-4873-90be-3c0e907ab2a0 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:51:13.699786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:13.705764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:13.718875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f92c8dbd-2758-40a0-a631-793ba3f7ad42 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1271 microversion: 2.1 time: 0.340540 Sep 07 14:51:13.719713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 405/791] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:13 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1271 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:13.725175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-62893092-851e-480c-90d3-fe164bd9f7c9 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 200 len: 1335 microversion: 2.1 time: 0.192810 Sep 07 14:51:13.726464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 387/792] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:13 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 1335 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:14.556623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:14.557234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:14.559809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:14.560488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=12 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:14.565176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.566234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.566234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.566739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.567188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.567607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.700398 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:14.708275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b23c6ee4-6ad5-409e-84fd-0e3cb28f780c tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1558 microversion: 2.1 time: 0.155429 Sep 07 14:51:14.708839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 406/793] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:14 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1558 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:14.738452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:14.738976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:14.741293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=8 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:14.746008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.750937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.750937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.750937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.750937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.751322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.753847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:14.754465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: caf09108-7a72-4873-90be-3c0e907ab2a0] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:14.760628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.761116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.761558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.762260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.762793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.763229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.777142 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] HTTP exception thrown: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Request method failure captured: Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 HTTP/1.1 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6hSJxdBi6eEy6U9AQlNuLcma5FbEFn44tj3RQeLKfgEKdoowbpvTF_UVgUzE5NXQn2-y_elTJqTzevwbeUEK_CCealAstti6cpYWMHC_7Pyywly0rLWZcEZrBoCjwhepRwxzij_WunQhGHq4SBmj70yE600gbZNaSdoeBkSKHl7oQ Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:51:14.779317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6869744faba14c0bb69be840cea600f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6869744faba14c0bb69be840cea600f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 9d8116d648d64a62af52d9db6a607e13 Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. Sep 07 14:51:14.780959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'caf09108-7a72-4873-90be-3c0e907ab2a0'} Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:51:14.781743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. Sep 07 14:51:14.783021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:51:14.784234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Returning 404 to user: Instance caf09108-7a72-4873-90be-3c0e907ab2a0 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:51:14.784234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d995b29f-8ce6-4fc9-862c-aeec0d2b5b80 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0" status: 404 len: 111 microversion: 2.1 time: 0.030874 Sep 07 14:51:14.784234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 407/794] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:14 2022] GET /compute/v2.1/servers/caf09108-7a72-4873-90be-3c0e907ab2a0 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 14:51:14.785692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:14.786300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:14.792294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.792784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.793220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.794548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:14.795006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:14.795428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:14.827565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9f831dae-e6e4-4104-ba8a-78bf11af9f45 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093026 Sep 07 14:51:14.828213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 388/795] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:51:14 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:14.832862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0f3934a4-94a7-4e1a-a6c3-6b046897ebe8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '.version_select at 0x7fefdf8483a0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:14.927188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:14.935969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6919e803-212b-4ce8-a7dd-ec4b8836f704 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.153717 Sep 07 14:51:14.936801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 408/796] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:14 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:14.950784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0f3934a4-94a7-4e1a-a6c3-6b046897ebe8 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097183700" status: 202 len: 0 microversion: 2.1 time: 0.121453 Sep 07 14:51:14.951631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 389/797] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:51:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2097183700 => generated 0 bytes in 123 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:51:15.865028 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "34293389-a94e-4532-ae7c-470650739524", "tag": "df5252c5-6e82-460c-b2a6-d9aa0ddefac1"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:15.876874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:15.877434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:15.878054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:15.892348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] Creating event network-changed:df5252c5-6e82-460c-b2a6-d9aa0ddefac1 for instance 34293389-a94e-4532-ae7c-470650739524 on hv-cinder-80135 Sep 07 14:51:15.897887 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-e100aa8f-9154-45b7-befb-3026a1c142bb req-b1adf4be-8994-4996-8ba4-f817747b9e32 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036303 Sep 07 14:51:15.898740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 409/798] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:15.960700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:15.961407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:15.972011 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:15.972746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:15.973341 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:15.974196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:15.974820 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:15.975719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:16.228056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:16.239019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d86df470-0e5b-45fe-a748-4965fb7fb1b7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.283311 Sep 07 14:51:16.239880 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 390/799] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:15 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:17.263197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:17.263821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:17.270233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:17.270713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:17.271146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:17.271849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:17.272321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:17.272742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:17.405727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:17.413617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4af09f84-237a-4a7a-96fc-6da1593607d9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.155141 Sep 07 14:51:17.414183 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 410/800] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:17 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:18.436885 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:18.437504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:18.444227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.444717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.445158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:18.445850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.446307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.446735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:18.575325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:18.583071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5a1a1dcf-a63b-40db-a4de-0ce1e486d4e8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.150092 Sep 07 14:51:18.583637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 391/801] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:18 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:18.628565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:18.629501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:18.635596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.636020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.636495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:18.637757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.638227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.638655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:18.664409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:51:18.964596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-201b35be-89c6-4925-9e75-f1e2a6e43df0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 204 len: 0 microversion: 2.1 time: 0.339467 Sep 07 14:51:18.965344 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 411/802] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:51:18 2022] DELETE /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:51:18.973620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:18.974240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:18.980412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.980897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.981338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:18.982038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:18.982492 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:18.982922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:19.114610 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:19.122678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fca50c37-e450-421c-9ef4-67dd5a0edb2c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1508 microversion: 2.1 time: 0.153049 Sep 07 14:51:19.123234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 392/803] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:18 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:19.607736 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:19.608540 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:19.614463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:19.614935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:19.615357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:19.616027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:19.616517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:19.616928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:19.748228 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:19.751928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:19.756669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ad81717e-48a1-4a89-95c4-7d31015e2710 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.153425 Sep 07 14:51:19.762146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 412/804] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:19 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:20.146002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:20.146620 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:20.154122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:20.154600 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:20.155033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:20.155726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:20.156206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:20.161784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:20.161784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:20.284770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:20.292338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aeed046e-1d65-43d4-aaf2-744c4cd1c423 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1508 microversion: 2.1 time: 0.150374 Sep 07 14:51:20.292901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 393/805] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:20 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:20.780297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:20.780952 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:20.788020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:20.788841 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:20.789004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:20.789693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:20.790146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:20.790566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:20.927170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:20.935559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-95071233-20b8-4427-9c36-e841b71d6bd9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.159365 Sep 07 14:51:20.936117 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 413/806] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:20 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:21.318124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:21.319079 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:21.328421 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:21.329128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:21.329759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:21.330799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:21.331408 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:21.331944 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:21.467255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:21.474867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-01f6ddcf-c304-42be-b181-c01ccf11b8f7 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1508 microversion: 2.1 time: 0.162915 Sep 07 14:51:21.475424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 394/807] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:21 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1508 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:21.958268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:21.964046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:21.966767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:21.967242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:21.967679 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:21.968414 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:21.968863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:21.969289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:22.196532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:22.204979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-97a427eb-5d24-4e9d-adf0-fa1634eb9bff tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.250738 Sep 07 14:51:22.205561 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 414/808] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:21 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:22.499021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:22.499737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:22.502486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "301a5877-a659-4739-8532-4e44fe18c220", "name": "network-vif-deleted", "tag": "2c86e722-7302-4ac6-a690-d68f41da2e37"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:22.506895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:22.507379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:22.508279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:22.508984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:22.509434 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:22.509950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:22.512495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:22.516275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:22.516275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:22.525710 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] Creating event network-vif-deleted:2c86e722-7302-4ac6-a690-d68f41da2e37 for instance 301a5877-a659-4739-8532-4e44fe18c220 on hv-cinder-80135 Sep 07 14:51:22.531165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-e30b66f2-e56d-410e-9094-5c499e699590 req-abb42cf8-f9ed-447e-b7ac-6e279a5596eb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032395 Sep 07 14:51:22.531967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 415/809] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:51:22.583095 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:22.591635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c79d99d8-d15c-477a-b332-bc8daa9d52fd tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1466 microversion: 2.1 time: 0.097324 Sep 07 14:51:22.592233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 395/810] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:22 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1466 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:23.228577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:23.229200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:23.236131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:23.236710 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:23.237148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:23.237839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:23.238293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:23.238720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:23.369613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:23.378343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4ba15fc-9be7-4f00-8f68-f3fdf1198fe8 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.154560 Sep 07 14:51:23.378913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 416/811] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:23 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:23.615177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:23.616676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:23.624309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:23.624798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:23.625237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:23.625945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:23.626402 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:23.627348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:23.662588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:23.663069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:23.663508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:23.663955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'fault' on Instance uuid 301a5877-a659-4739-8532-4e44fe18c220 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:51:23.704369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:23.712187 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-42a5129f-7191-41d6-af33-da5ab39feaab tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 200 len: 1311 microversion: 2.1 time: 0.101081 Sep 07 14:51:23.713084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 396/812] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:23 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 1311 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:24.401399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:24.402006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:24.408445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.408927 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.409356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.410041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.410489 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.410908 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.540230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:24.548497 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-37a32da8-d353-4f82-a002-db635090ef8c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.150886 Sep 07 14:51:24.549063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 417/813] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:24 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:24.736173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:24.736848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 301a5877-a659-4739-8532-4e44fe18c220] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:24.743665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.744173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.744611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.745339 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.745788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.746216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.760650 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] HTTP exception thrown: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Request method failure captured: Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 HTTP/1.1 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6hSJxdBi6eEy6U9AQlNuLcma5FbEFn44tj3RQeLKfgEKdoowbpvTF_UVgUzE5NXQn2-y_elTJqTzevwbeUEK_CCealAstti6cpYWMHC_7Pyywly0rLWZcEZrBoCjwhepRwxzij_WunQhGHq4SBmj70yE600gbZNaSdoeBkSKHl7oQ Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:51:24.762294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6869744faba14c0bb69be840cea600f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6869744faba14c0bb69be840cea600f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 9d8116d648d64a62af52d9db6a607e13 Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. Sep 07 14:51:24.763874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '301a5877-a659-4739-8532-4e44fe18c220'} Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:51:24.764803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. Sep 07 14:51:24.766388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:24.767940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Returning 404 to user: Instance 301a5877-a659-4739-8532-4e44fe18c220 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:51:24.767940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b8525ed6-3a55-466a-b1b8-ffd691ac0435 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220" status: 404 len: 111 microversion: 2.1 time: 0.032049 Sep 07 14:51:24.767940 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 397/814] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:24 2022] GET /compute/v2.1/servers/301a5877-a659-4739-8532-4e44fe18c220 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 14:51:24.772530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:24.773026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:24.779039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.779523 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.779968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.780755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:24.781214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:24.781636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:24.808820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:51:25.040929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24e622ae-d304-4167-8d8c-ae9686a57572 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "DELETE /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 204 len: 0 microversion: 2.1 time: 0.272125 Sep 07 14:51:25.041517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 418/815] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:51:24 2022] DELETE /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:51:25.050798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:25.051503 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:25.057381 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:25.058080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:25.058491 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:25.059585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:25.060263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:25.060966 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:25.070734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "name": "network-vif-plugged", "status": "completed", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:25.081622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:25.082263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:25.082793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:25.096519 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] Creating event network-vif-plugged:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:51:25.102360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-fa9901e0-5496-4cb5-ab72-f9715366925f req-f3bee7d6-8076-4e49-a51a-e0c1693179ae service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.097304 Sep 07 14:51:25.103108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 398/816] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:25.194786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:25.202611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8e11b715-fb2a-4ff0-b9c0-32d760d478b0 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.156238 Sep 07 14:51:25.203173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 419/817] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:25 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:25.571456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:25.572165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:25.578785 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:25.579260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:25.579692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:25.580400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:25.580850 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:25.581275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:25.710169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:25.720245 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-09e1db9c-b8b0-4df2-864c-f5fdefb47a0c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.152877 Sep 07 14:51:25.727024 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 399/818] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:25 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:26.225393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:26.225932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:26.232923 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:26.233409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:26.233848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:26.234537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:26.234990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:26.235413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:26.365409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:26.374156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d254f56e-a20b-41cd-befd-ad2d4c1cd1b6 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.152733 Sep 07 14:51:26.374769 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 420/819] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:26 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:26.743627 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:26.744256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:26.750986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:26.751473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:26.751913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:26.752640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:26.753098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:26.753526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:26.882717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:26.890865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7b6ef6d4-a7f5-4e66-9b67-ab1f472efc6c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.151460 Sep 07 14:51:26.891417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 400/820] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:26 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:27.397951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:27.398564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:27.405490 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:27.405974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:27.418734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:27.418734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:27.418734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:27.418734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:27.543576 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:27.551602 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-41c6bc9a-671b-483e-a04a-3b27d34b0c18 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1522 microversion: 2.1 time: 0.157712 Sep 07 14:51:27.552186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 421/821] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:27 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:27.914692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:27.915299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:27.923483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:27.924692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:27.924692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:27.925480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:27.926237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:27.926967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:28.066176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:28.073774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-90248f42-422d-49d7-8cc1-ff6d099ae798 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1259 microversion: 2.1 time: 0.163601 Sep 07 14:51:28.074329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 401/822] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:27 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:28.183455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74bb9f3f-4ce1-4649-997e-77d7079c6ee9", "name": "network-vif-deleted", "tag": "c4cce5f5-f4ed-4887-920c-bc901c548597"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:28.192861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:28.193341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:28.193794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:28.204404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] Creating event network-vif-deleted:c4cce5f5-f4ed-4887-920c-bc901c548597 for instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 on hv-cinder-80135 Sep 07 14:51:28.209208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-e38e82f2-aa50-4281-a1e0-6728233a7d52 req-d7f8aeba-3e02-45b7-b65d-4b2bca99a72c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029429 Sep 07 14:51:28.209775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 422/823] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:28.574625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:28.576191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:28.583671 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:28.584374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:28.584891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:28.585676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:28.586228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:28.586764 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:28.651555 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:28.659311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-079d632f-d93f-48a7-9735-8730f44dd39c tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1306 microversion: 2.1 time: 0.088670 Sep 07 14:51:28.659881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 402/824] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:28 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1306 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:29.096670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:29.097385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:29.104040 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.104543 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.104970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.105654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.106098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.107010 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.242180 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:29.255408 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f949fe47-c216-482b-93b7-39507e6c6d37 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1442 microversion: 2.1 time: 0.162931 Sep 07 14:51:29.256361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 423/825] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:29 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:29.277990 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:29.278622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:29.285009 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.285508 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.285939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.286616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.287060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.287477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.423374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:29.431050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e944cac8-e640-481f-b830-4639aa394184 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1442 microversion: 2.1 time: 0.156814 Sep 07 14:51:29.431602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 403/826] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:29 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:29.682658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:29.683278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:29.689864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.690428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.690939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.691773 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.692487 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.693026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.724618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:29.725194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:29.725631 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:29.726073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lazy-loading 'fault' on Instance uuid 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:51:29.778359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d8116d648d64a62af52d9db6a607e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6869744faba14c0bb69be840cea600f0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:29.787144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-986e20de-4934-4e65-8d57-cd7a1d62f661 tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 200 len: 1311 microversion: 2.1 time: 0.108657 Sep 07 14:51:29.787730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 424/827] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:29 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:30.811670 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:30.812593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] [instance: 74bb9f3f-4ce1-4649-997e-77d7079c6ee9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:30.819851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:30.820431 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:30.821026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:30.821998 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:30.822651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:30.823285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:30.840204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] HTTP exception thrown: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Request method failure captured: Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 HTTP/1.1 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6hSJxdBi6eEy6U9AQlNuLcma5FbEFn44tj3RQeLKfgEKdoowbpvTF_UVgUzE5NXQn2-y_elTJqTzevwbeUEK_CCealAstti6cpYWMHC_7Pyywly0rLWZcEZrBoCjwhepRwxzij_WunQhGHq4SBmj70yE600gbZNaSdoeBkSKHl7oQ Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:51:30.841938 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6869744faba14c0bb69be840cea600f0"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6869744faba14c0bb69be840cea600f0"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6869744faba14c0bb69be840cea600f0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 6869744faba14c0bb69be840cea600f0 Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-390973019 Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 9d8116d648d64a62af52d9db6a607e13 Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-ServerRescueNegativeTestJSON-390973019-project Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. Sep 07 14:51:30.843509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '74bb9f3f-4ce1-4649-997e-77d7079c6ee9'} Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:51:30.844406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. Sep 07 14:51:30.845752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:51:30.846865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] Returning 404 to user: Instance 74bb9f3f-4ce1-4649-997e-77d7079c6ee9 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:51:30.846865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7019aeb1-c7a7-4fa3-9695-9dd88aa7eaff tempest-ServerRescueNegativeTestJSON-390973019 tempest-ServerRescueNegativeTestJSON-390973019-project] 10.222.0.57 "GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9" status: 404 len: 111 microversion: 2.1 time: 0.036411 Sep 07 14:51:30.846865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 404/828] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:30 2022] GET /compute/v2.1/servers/74bb9f3f-4ce1-4649-997e-77d7079c6ee9 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:51:31.395820 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:31.407520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:31.408125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:31.408676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:31.421653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] Creating event network-changed:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:51:31.426857 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-1156768b-26f2-4d66-b0fc-d4c27cb64ef0 req-ff3365a3-cecd-45a9-83df-c3de7110a613 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034799 Sep 07 14:51:31.427881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 425/829] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:37.162511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:37.163071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:37.169588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:37.170126 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:37.170566 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:37.171265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:37.171723 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:37.172167 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:37.196077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c3332700-d52b-4989-8fa8-e030bc6f9168 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/ips" status: 200 len: 151 microversion: 2.20 time: 0.037522 Sep 07 14:51:37.197013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 405/830] 10.222.0.57 () {60 vars in 1289 bytes} [Wed Sep 7 14:51:37 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 07 14:51:39.310075 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:39.311336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:39.319404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:39.319960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:39.320556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:39.321443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:39.322048 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:39.322630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:39.348580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lazy-loading 'flavor' on Instance uuid cb4065a1-6ecd-4b81-9fee-b19edb507e3d {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:51:39.928481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0480e5c7-b8ad-4aae-862c-d571b996bdf4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/action" status: 202 len: 0 microversion: 2.20 time: 0.624298 Sep 07 14:51:39.930014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 426/831] 10.222.0.57 () {62 vars in 1319 bytes} [Wed Sep 7 14:51:39 2022] POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/action => generated 0 bytes in 627 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:51:39.940642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:39.942467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:39.951367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=59,nova_api:DELETE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:39.953320 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:39.954029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:39.954710 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:39.955641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:39.956506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:39.957325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:40.116205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:40.125270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:40.126688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:40.128097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2445098c-f3d3-4e3a-b52b-d8e6410ffacd tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.192425 Sep 07 14:51:40.145535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 406/832] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:39 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:41.156651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:41.157351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:41.163856 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:41.164626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:41.165244 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:41.166106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:41.166712 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:41.167289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:41.209678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:41.368190 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:41.380217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:41.381985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:41.383209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7f46c653-437a-4f5c-beb1-86f4532472e7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.231533 Sep 07 14:51:41.383761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 427/833] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:41 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:41.678487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-18a6054d-56a7-4f72-b7c6-714b4d69842d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: .version_select at 0x7fefdf8a29d0>, body: {"keypair": {"name": "tempest-keypair-1961214077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPfHBuhnHLlZjHqaYxiHjNhaGPaxw5UGMHMdgVcyRrviY78Kp59O7JEHIY2Qssig3DB3uMJ3E7TGCu8vPjDsuLGqjVQl79ynCtUmksLUmlU95MsNQ2XDAi2AH7pAEhK9kA=="}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:41.694888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-18a6054d-56a7-4f72-b7c6-714b4d69842d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for project 375694ab50a34237bf53010138421f1b. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:51:41.698861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-18a6054d-56a7-4f72-b7c6-714b4d69842d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for user 6e21a071d561423689653593b30cdaed and project 375694ab50a34237bf53010138421f1b. Resources: {'key_pairs'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:51:41.848622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-18a6054d-56a7-4f72-b7c6-714b4d69842d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.293487 Sep 07 14:51:41.849565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 407/834] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:51:41 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:42.412453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:42.412453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:42.416674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:42.417163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:42.417595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:42.418297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:42.418752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:42.419174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:42.823963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:42.832840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:42.834270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:42.835419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-063f34a5-f1e4-473e-b9d3-cc7f632a6d33 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.430745 Sep 07 14:51:42.835973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 428/835] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:42 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:43.862066 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:43.862684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:43.870107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:43.870594 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:43.871032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:43.871722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:43.872201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:43.872633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:44.015867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:44.024726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:44.026520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:44.027716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-852776d0-ea62-40cf-8155-357020ad3bb9 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.170389 Sep 07 14:51:44.028699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 408/836] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:43 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:44.178116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-197465829", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "061d2f3b-e283-46de-a112-7b320d82db52"}], "security_groups": [{"name": "tempest-securitygroup--1938442321"}], "key_name": "tempest-keypair-1961214077", "user_data": "}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:44.281074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] validate_networks() for [('061d2f3b-e283-46de-a112-7b320d82db52', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:51:44.653635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:51:44.654168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:51:44.654723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:51:44.655206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:51:44.655725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:51:44.657833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:44.665365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:44.670595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:44.670595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:44.670595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:44.670595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:44.670969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:44.686965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for project 375694ab50a34237bf53010138421f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:51:44.691183 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for user 6e21a071d561423689653593b30cdaed and project 375694ab50a34237bf53010138421f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:51:44.704382 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:51:44.707076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:51:44.880471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-aa63933f-e376-4f1a-9a88-6d77f973c074 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.706590 Sep 07 14:51:44.881313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 429/837] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:51:44 2022] POST /compute/v2.1/servers => generated 402 bytes in 708 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:51:44.893285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-466967fa-2ab8-451b-9871-ec89e8c61c9a tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:44.894521 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-466967fa-2ab8-451b-9871-ec89e8c61c9a tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:44.952907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-466967fa-2ab8-451b-9871-ec89e8c61c9a tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:44.959831 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-466967fa-2ab8-451b-9871-ec89e8c61c9a tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1237 microversion: 2.1 time: 0.071193 Sep 07 14:51:44.960728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 409/838] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:44 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1237 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:45.058483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:45.059546 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:45.069825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:45.070591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:45.071102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:45.071878 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:45.072658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:45.073302 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:45.222006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:45.231193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:45.232937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:45.234094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d9c47232-74f2-45af-a7c9-3dedf3b3b86f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.179593 Sep 07 14:51:45.235022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 430/839] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:45 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:45.984875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d5e35f4c-7589-4456-a35d-09962a076c37 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:45.985520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d5e35f4c-7589-4456-a35d-09962a076c37 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:46.040909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d5e35f4c-7589-4456-a35d-09962a076c37 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:46.049097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d5e35f4c-7589-4456-a35d-09962a076c37 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1237 microversion: 2.1 time: 0.068536 Sep 07 14:51:46.049917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 410/840] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:45 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1237 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:46.261287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:46.261890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:46.268813 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:46.269321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:46.270000 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:46.270686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:46.271131 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:46.271545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:46.406299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:46.414935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:46.416391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:46.417567 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-641bc5c6-7eda-40a5-b299-a38fe72a9984 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.160145 Sep 07 14:51:46.418119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 431/841] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:46 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:47.072760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:47.073378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:47.080031 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:47.080529 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:47.081014 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:47.081709 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:47.082158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:47.082576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:47.148131 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:47.157143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-55c627f3-634d-415a-9767-5883d9d764f6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1233 microversion: 2.1 time: 0.088572 Sep 07 14:51:47.157957 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 411/842] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:47 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1233 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:47.442522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:47.443135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:47.449478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:47.449965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:47.450400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:47.451090 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:47.451550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:47.451976 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:47.582324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:47.590483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:47.592425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:47.593560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3060a91d-d41a-45d8-9971-fe8a64cc5efe tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.154908 Sep 07 14:51:47.594112 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 432/843] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:47 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:48.181135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:48.181740 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:48.189909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:48.190398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:48.190878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:48.191571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:48.192025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:48.192478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:48.264925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:48.272819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1d0f1397-3be5-45fc-a0d6-8666481b071c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1307 microversion: 2.1 time: 0.095421 Sep 07 14:51:48.278628 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 412/844] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:48 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1307 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:51:48.619009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:48.619625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:48.626640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:48.627079 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:48.632770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:48.632770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:48.632770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:48.632770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:48.874974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:48.884791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:48.886888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:48.887734 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eb8215c5-24db-401d-967b-58f9a934be54 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.272679 Sep 07 14:51:48.888548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 433/845] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:48 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:49.297012 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:49.297750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:49.304272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:49.304855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:49.305372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:49.306077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:49.306534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:49.306964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:49.501188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:49.508791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f4d25c21-f23f-4525-a524-c7abc885def8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.216368 Sep 07 14:51:49.509358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 413/846] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:49 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:49.847270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4568f808-8f55-4c2a-8f9e-9b0d1ec93a23", "tag": "7c410199-eb0f-4d91-b1be-d6b7ba21ad22"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:49.851776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:49.852285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:49.852716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:49.865580 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] Creating event network-changed:7c410199-eb0f-4d91-b1be-d6b7ba21ad22 for instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 on hv-cinder-80135 Sep 07 14:51:49.870749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-596e5915-4eef-45b3-a79e-8bef91a20697 req-37b9be34-c0b6-4ed0-bef1-f8c78179c030 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033157 Sep 07 14:51:49.871666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 434/847] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:49.915168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:49.915817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:49.922480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:49.922960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:49.923657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:49.924185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:49.924639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:49.925061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:50.126244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:50.129856 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:50.134765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:50.136264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:50.137448 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3a466694-0ff6-47de-9974-962adfdedfe0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.227164 Sep 07 14:51:50.138009 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 414/848] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:49 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:50.533295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:50.534015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:50.540132 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:50.540632 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:50.541062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:50.541737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:50.542193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:50.542607 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:50.758846 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:50.767509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-035776bd-901b-4cbf-940d-0f23ef6c5942 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.239188 Sep 07 14:51:50.768312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 435/849] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:50 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:51.163991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:51.164629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:51.171401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:51.171883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:51.172360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:51.173046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:51.173507 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:51.173937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:51.302073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:51.310734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:51.313038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:51.314219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ea6a87d1-489b-4889-a4a5-ac576ededfea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1744 microversion: 2.20 time: 0.154127 Sep 07 14:51:51.314783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 415/850] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:51 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:51.790862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:51.791469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:51.798329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:51.798830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:51.799243 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:51.799926 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:51.800409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:51.800830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:51.925467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:51.933049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4463cc70-2329-4419-abf6-9d5f3be7ebe6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.146112 Sep 07 14:51:51.933624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 436/851] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:51 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:52.340184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:52.340828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:52.347268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.347749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.348240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:52.348936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.349389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.349814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:52.474614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:52.482647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:52.484625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:52.485782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2146f749-7b32-48b8-b4d7-5959918af96f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1744 microversion: 2.20 time: 0.149493 Sep 07 14:51:52.486334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 416/852] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:52 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1744 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:52.647581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:52.648016 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:52.653988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.654468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.654898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:52.656119 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.656600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.657018 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:52.680205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3d4139ee-6d12-4f4e-9276-867395210018 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/ips" status: 200 len: 149 microversion: 2.1 time: 0.036740 Sep 07 14:51:52.680895 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 437/853] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:51:52 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/ips => generated 149 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:52.955701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:52.956379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:52.962321 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.962814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.963253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:52.963987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:52.964481 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:52.964909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:53.142426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:53.151531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0e1b6e49-00e8-490f-8be5-f930ac82138f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.200194 Sep 07 14:51:53.152340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 417/854] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:52 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:53.513091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:53.514112 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:53.522170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:53.522666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:53.523205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:53.526957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:53.527429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:53.527858 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:53.698400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:53.707663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:53.709480 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:53.710950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9454ae8e-8fda-472b-8c82-6bb0afbadc6a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.203154 Sep 07 14:51:53.711654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 438/855] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:53 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:51:54.175585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:54.176306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:54.184484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.184984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.185429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.186142 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.187206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.189738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.359862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:54.368731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-68cff2a5-03aa-45ca-ad54-d2cffa1f8e46 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.197387 Sep 07 14:51:54.369677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 418/856] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:54 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:54.421093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fba9ebfe-a299-4e4e-912d-6aeffd5825f9"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:54.423719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:54.430128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.430824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.431426 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.432122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.432594 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.433174 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.676206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:54.699213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:54.738327 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:54.738944 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:54.748419 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.749827 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.750712 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.751728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:54.752563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:54.753156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:54.896755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:54.927916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:54.929307 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:54.930489 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f154bb23-0ff0-4f36-9a5d-824993e08b97 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.197229 Sep 07 14:51:54.931036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 419/857] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:54 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:51:55.226163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4568f808-8f55-4c2a-8f9e-9b0d1ec93a23", "name": "network-vif-plugged", "status": "completed", "tag": "7c410199-eb0f-4d91-b1be-d6b7ba21ad22"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:55.238049 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:55.238586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:55.239145 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:55.250136 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2a68912d-161d-40c7-8528-0de5c0939f7a tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "POST /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.832007 Sep 07 14:51:55.252705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 439/858] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:51:54 2022] POST /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments => generated 194 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:55.255465 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] Creating event network-vif-plugged:7c410199-eb0f-4d91-b1be-d6b7ba21ad22 for instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 on hv-cinder-80135 Sep 07 14:51:55.269003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-52641f24-a93f-40af-9891-c7529909161e req-22115e4b-7346-40d8-8797-3235a6b00aba service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046632 Sep 07 14:51:55.272888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 420/859] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:51:55.398447 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:55.399986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:55.417037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:55.418248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:55.418918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:55.421628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:55.423771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:55.425737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:55.691659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:55.703152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-86da9eef-fc02-41ce-9146-158ee000a6e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.312256 Sep 07 14:51:55.720006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 440/860] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:55 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:55.961212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:55.961848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:55.968418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:55.969233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:55.970010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:55.970999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:55.971861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:55.972556 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:56.045378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=8 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:56.149490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:56.158666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:56.162212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:56.162212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a44994f6-4f22-4317-bec4-95695566f21b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.205213 Sep 07 14:51:56.162212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 421/861] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:55 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:56.727341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:56.728009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:56.735022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:56.735558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:56.736017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:56.736788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:56.737268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:56.737694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:56.885597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:56.894123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4596be29-7016-4862-a5a6-5fbf297a5151 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1363 microversion: 2.1 time: 0.171009 Sep 07 14:51:56.894693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 441/862] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:56 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1363 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:57.187861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:57.188733 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:57.195360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:57.196109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:57.196795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:57.197750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:57.198606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:57.199357 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:57.294673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "name": "network-vif-plugged", "status": "completed", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:57.308200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:57.308928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:57.309532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:57.322367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] Creating event network-vif-plugged:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:51:57.328261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-ec199c19-9d10-4198-80bc-54a92a902b5d req-ea052c0d-bb53-48f7-93fe-f5e813753064 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039627 Sep 07 14:51:57.329037 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 442/863] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:51:57.378875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:57.388437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:57.390514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:57.392279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1204d278-5b19-45b8-b880-a38605bff24e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.208810 Sep 07 14:51:57.393641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 422/864] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:57 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:57.919322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:57.920338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:57.927624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:57.928139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:57.928624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:57.929327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:57.929775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:57.930197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:58.080691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:58.088683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-24e355b3-92cf-45dd-b54a-7c3ebb721f02 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1549 microversion: 2.1 time: 0.174103 Sep 07 14:51:58.089527 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 443/865] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:51:57 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1549 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:51:58.112888 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:58.113388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:58.119689 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:58.120365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:58.120912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:58.123567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:58.123567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:58.123567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:58.218551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7c46abfc-732d-4323-a4cd-1938a25b4300 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.110200 Sep 07 14:51:58.228109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 423/866] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:51:58 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:58.418558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:58.419350 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:58.429619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:58.430373 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:58.431070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:58.431988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:58.432473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:58.432895 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:58.718928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:58.728996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:58.730873 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:58.732433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-47be617a-350a-4b77-a15c-82b8aa172e68 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.317975 Sep 07 14:51:58.734259 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 444/867] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:58 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:51:59.727183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4568f808-8f55-4c2a-8f9e-9b0d1ec93a23", "tag": "7c410199-eb0f-4d91-b1be-d6b7ba21ad22"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:51:59.737480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:59.738029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:59.738526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:59.750483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] Creating event network-changed:7c410199-eb0f-4d91-b1be-d6b7ba21ad22 for instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 on hv-cinder-80135 Sep 07 14:51:59.755768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-0d80400c-7e61-4093-85c9-97fbb3f5735b req-231931a2-bdea-44d4-8deb-113e2eb44fd9 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033064 Sep 07 14:51:59.757654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 424/868] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:51:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:51:59.764397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:51:59.765187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:51:59.773685 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:59.774738 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:59.775437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:59.776479 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:51:59.777029 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:51:59.777481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:51:59.782939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:51:59.990118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:51:59.998579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:00.000063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:00.001268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3dd2e646-5885-462f-9503-e239bbcf4a55 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.241840 Sep 07 14:52:00.007122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 445/869] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:51:59 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:01.028939 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:01.029656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:01.036212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:01.036936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:01.037561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:01.038438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:01.039242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:01.039359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:01.185681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:01.195403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:01.197139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:01.198617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f3e2a0be-0ac3-47f4-9aa1-71b51bc3c3ea tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.175214 Sep 07 14:52:01.199260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 425/870] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:01 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:02.225317 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:02.225875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:02.231953 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:02.232473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:02.233220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:02.234136 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:02.234836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:02.235471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:02.379191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:02.387895 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:02.389620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:02.391188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f0ad0591-d99f-46a4-a113-46cbe59bf996 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.170428 Sep 07 14:52:02.409139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 446/871] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:02 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:03.419004 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:03.419616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:03.426641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:03.427434 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:03.428075 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:03.428986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:03.429736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:03.430354 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:03.573255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:03.581737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:03.583177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:03.584388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f6b9c337-087d-4fb9-82e8-126ca139089f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1739 microversion: 2.20 time: 0.169348 Sep 07 14:52:03.584943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 426/872] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:03 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:04.070676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:04.071198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:04.077559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.078038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.078465 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.079144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.079591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.080009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.160768 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.objects.instance [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'services' on Instance uuid 34293389-a94e-4532-ae7c-470650739524 {{(pid=127536) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:52:04.375440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-09c16a0d-d807-477d-b10b-9897d40c1131 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments/fba9ebfe-a299-4e4e-912d-6aeffd5825f9" status: 202 len: 0 microversion: 2.1 time: 0.308391 Sep 07 14:52:04.376233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 447/873] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:52:04 2022] DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments/fba9ebfe-a299-4e4e-912d-6aeffd5825f9 => generated 0 bytes in 310 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:52:04.384501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:04.386661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:04.398912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.399535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.400022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.400807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.401335 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.401834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.432213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dbb1a85e-36c6-45d2-bf53-f1147df44468 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051628 Sep 07 14:52:04.432848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 427/874] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:52:04 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:04.611103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:04.611796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:04.617843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.618319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.618743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.619481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:04.619884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:04.620328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:04.802115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:04.810244 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:04.811723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:04.812928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f8971b70-4413-44e9-b908-089c5a2eb6ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1721 microversion: 2.20 time: 0.206791 Sep 07 14:52:04.813477 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 448/875] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:04 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1721 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:05.445459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:05.447643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:05.454774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:05.455257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:05.455692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:05.456415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:05.456873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:05.457301 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:05.486518 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-44fcac3e-6419-4637-adcd-86bc760708fa tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044950 Sep 07 14:52:05.488388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 428/876] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:52:05 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:05.838610 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:05.839211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:05.845883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:05.846359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:05.846791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:05.847469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:05.847912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:05.848370 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:05.974216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:05.982377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:05.984310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:05.985449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-029f2391-04ab-49a1-9fdd-b849b9743937 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1721 microversion: 2.20 time: 0.150778 Sep 07 14:52:05.985998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 449/877] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:05 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:06.498577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:06.500752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:06.507214 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:06.507685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:06.508112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:06.508815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:06.509263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:06.509685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:06.539417 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-27d785b0-b7e3-4e8e-b53b-0afe4fed3c31 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044767 Sep 07 14:52:06.539945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 429/878] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:52:06 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:07.010069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:07.010859 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:07.018108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.019249 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.019691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.020883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.021375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.021804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.158077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:07.166522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:07.168020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:07.169217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ddafbd78-d871-4b69-9852-5bc22a20fc4c tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1721 microversion: 2.20 time: 0.163259 Sep 07 14:52:07.169796 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 450/879] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:07 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:07.551430 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:07.553616 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:07.559788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.560296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.560730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.562018 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.562470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.562894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.590975 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d08948f8-468b-4fdc-9481-729b7220427d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043524 Sep 07 14:52:07.591514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 430/880] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:52:07 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:52:07.657947 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:07.658448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:07.664474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.664958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.665399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.666089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:07.666544 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:07.667008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:07.694128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:52:07.992881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b1788de2-77af-4816-ab9e-f438aa49aead tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 204 len: 0 microversion: 2.1 time: 0.338845 Sep 07 14:52:07.993529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 451/881] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:07 2022] DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:52:08.002468 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:08.003092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:08.009176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.009675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.010102 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.010780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.011223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.011642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.137846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:08.146324 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-60caa245-5eb0-4573-9b18-402affe04afd tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1682 microversion: 2.1 time: 0.148499 Sep 07 14:52:08.146889 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 431/882] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:07 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:08.194061 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:08.194766 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:08.201213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.202169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.202608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.203287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.203737 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.204172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.338279 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:08.346410 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:08.347836 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:08.349021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2edf00d5-35d0-4eda-8a39-338e30659727 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1664 microversion: 2.20 time: 0.159150 Sep 07 14:52:08.349577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 452/883] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:08 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1664 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:08.374327 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5821c2c5-2365-46c9-a866-9b7e45ad7f12"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:08.376771 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:08.382717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.383195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.383625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.384343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:08.384796 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:08.385217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:08.461127 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:09.106825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "name": "network-vif-unplugged", "status": "completed", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:09.117837 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:09.118320 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:09.118751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:09.129861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.compute.server_external_events [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] Unable to find a host for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d. Dropping event network-vif-unplugged {{(pid=127536) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 07 14:52:09.130735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-f48110a7-b4cf-459b-bf82-f6a9911e7650 req-19861645-1a2c-40d5-bc99-76a83c89b029 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.027738 Sep 07 14:52:09.131309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 453/884] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:52:09 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 29 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 07 14:52:09.169690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:09.170300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:09.177224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:09.177715 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:09.181078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:09.181078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:09.181078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:09.181078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:09.317389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:09.325519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c377137a-869a-437b-9ede-314b3560160e tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1682 microversion: 2.1 time: 0.159516 Sep 07 14:52:09.326105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 454/885] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:09 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1682 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:09.423576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f28bbf97-7a7c-4642-b718-9c061d31ccb7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.053635 Sep 07 14:52:09.424134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 432/886] 10.222.0.57 () {62 vars in 1364 bytes} [Wed Sep 7 14:52:08 2022] POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments => generated 188 bytes in 1055 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 07 14:52:09.549653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:09.550151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:09.556089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:09.556840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:09.557281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:09.557968 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:09.558425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:09.558851 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.129211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-97b0a32a-566d-4728-a17c-e1e0e95634fa tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments/5821c2c5-2365-46c9-a866-9b7e45ad7f12" status: 202 len: 0 microversion: 2.20 time: 0.583342 Sep 07 14:52:10.130146 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 455/887] 10.222.0.57 () {60 vars in 1457 bytes} [Wed Sep 7 14:52:09 2022] DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments/5821c2c5-2365-46c9-a866-9b7e45ad7f12 => generated 0 bytes in 585 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:52:10.196774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:10.197369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:10.205629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.206110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.206726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.207532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.207984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.208435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.301515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127537) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 14:52:10.348894 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:10.349517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:10.356718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.357153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.357586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.358772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.359407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.359829 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.454681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:10.464229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4dd0ba8-c953-4993-8a1b-119263c54030 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1614 microversion: 2.1 time: 0.119884 Sep 07 14:52:10.465111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 456/888] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:10 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1614 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:10.591744 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bf7df63a-2391-4049-8b78-eaef1806ea1f tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/action" status: 202 len: 0 microversion: 2.20 time: 0.399340 Sep 07 14:52:10.593318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 433/889] 10.222.0.57 () {62 vars in 1319 bytes} [Wed Sep 7 14:52:10 2022] POST /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/action => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:52:10.601316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:10.601928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:10.608930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.609400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.610035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.610743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.613286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.613793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.645856 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "34293389-a94e-4532-ae7c-470650739524", "name": "network-vif-deleted", "tag": "df5252c5-6e82-460c-b2a6-d9aa0ddefac1"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:10.666549 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:10.667418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:10.667962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:10.699969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] Creating event network-vif-deleted:df5252c5-6e82-460c-b2a6-d9aa0ddefac1 for instance 34293389-a94e-4532-ae7c-470650739524 on hv-cinder-80135 Sep 07 14:52:10.734598 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-2712bf92-e7c3-4693-ad35-8da657c5b326 req-bf62ce08-c4af-4273-88c6-fdd5fdaa2c02 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089625 Sep 07 14:52:10.735535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 434/890] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:52:10.783237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:10.785726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:10.793220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:10.798652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:10.798652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-25c9316e-3757-4d37-8ac2-b40b363c39d5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1672 microversion: 2.20 time: 0.199265 Sep 07 14:52:10.798652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 457/891] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:10 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1672 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:52:11.488652 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:11.489362 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:11.495791 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:11.496577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:11.497015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:11.497723 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:11.498180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:11.499174 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:11.533661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:11.534141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:11.534750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:11.535372 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lazy-loading 'fault' on Instance uuid 34293389-a94e-4532-ae7c-470650739524 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:52:11.584602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8eb5509df78d45acbebc332a889251dc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e03d56845a594ecf9c320b2d70a633ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:11.593987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f746d6e6-651e-4590-afd6-fe50567596d0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 200 len: 1332 microversion: 2.1 time: 0.109974 Sep 07 14:52:11.604318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 435/892] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:11 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 1332 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:11.824113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:11.824817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:11.831811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:11.832333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:11.832811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:11.833532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:11.834517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:11.834955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:11.969939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:11.980421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:11.982121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:11.983948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2200288e-5215-4a44-8883-8a11dda72f24 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1672 microversion: 2.20 time: 0.165195 Sep 07 14:52:11.984528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 458/893] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:11 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1672 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:12.617175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:12.617979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:12.620087 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:12.624857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:12.625604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:12.626114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:12.626743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:12.627201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:12.627662 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:12.644945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 HTTP/1.1 Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:52:12.646811 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:12.648511 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '34293389-a94e-4532-ae7c-470650739524'} Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:12.650165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:12.651743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:12.653120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:12.653120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-28a82419-ed63-4b76-9281-b7da2c88f59d tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 404 len: 111 microversion: 2.1 time: 0.035142 Sep 07 14:52:12.653120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 436/894] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:12 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:12.657819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c5db4524-94e7-4d4e-8a0d-5a7bc366123b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '.version_select at 0x7fefdf83e940>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:12.754408 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c5db4524-94e7-4d4e-8a0d-5a7bc366123b tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321472239" status: 202 len: 0 microversion: 2.1 time: 0.101023 Sep 07 14:52:12.755303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 459/895] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:52:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1321472239 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:52:13.012567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:13.014004 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:13.023999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:13.024516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:13.025715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:13.026596 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:13.027223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:13.028117 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:13.234265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:13.243014 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:13.244589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:13.245753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4a7ae538-6ce5-44b0-996b-c2748f963b99 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.240350 Sep 07 14:52:13.246306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 437/896] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:13 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:14.273244 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:14.274558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:14.281009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.282379 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.283005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.284173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.284816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.285423 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.428156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:14.436519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:14.438515 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:14.439663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-032c0c88-aae9-4689-9f88-d2d2d173ca8b tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.171241 Sep 07 14:52:14.440228 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 460/897] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:14 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:14.787096 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:14.787884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:14.797900 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.798400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.798810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.799509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.799959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.800399 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.814894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 HTTP/1.1 Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:52:14.816943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.818535 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '34293389-a94e-4532-ae7c-470650739524'} Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:14.819466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.820914 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.823086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:14.823943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a0799890-2c5c-4ed8-9b42-fa8e2aacfbf0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 404 len: 111 microversion: 2.1 time: 0.040595 Sep 07 14:52:14.824528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 438/898] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:14 2022] DELETE /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:14.832608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:14.833228 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 34293389-a94e-4532-ae7c-470650739524] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:14.839642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.840134 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.840600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.841308 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:14.847019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:14.847496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:14.862600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 HTTP/1.1 Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:52:14.864269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.870678 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '34293389-a94e-4532-ae7c-470650739524'} Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:14.871578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. Sep 07 14:52:14.873032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:14.874919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 34293389-a94e-4532-ae7c-470650739524 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:14.874919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-927705b4-43e9-4922-85d9-c9374bcf0909 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524" status: 404 len: 111 microversion: 2.1 time: 0.036854 Sep 07 14:52:14.874919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 461/899] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:14 2022] GET /compute/v2.1/servers/34293389-a94e-4532-ae7c-470650739524 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:15.466315 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:15.467332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:15.474578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:15.475075 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:15.475806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:15.476548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:15.477019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:15.477447 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:15.636232 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:15.645770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:15.649406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:15.653355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ea54b8ef-e610-4eed-b4f0-37c3b99200c0 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.189143 Sep 07 14:52:15.653355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 439/900] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:15 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:52:16.162662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:16.163362 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:16.165586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:16.175861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.180879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.180879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.180879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.180879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.181335 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.193495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a HTTP/1.1 Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:52:16.195035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.196651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'c5ae47dd-c46e-4a26-9a32-b659fdebd24a'} Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:16.200680 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.202234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.204231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:16.204231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-25ca3cff-c531-4173-94ae-43fe43246f95 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 404 len: 111 microversion: 2.1 time: 0.037679 Sep 07 14:52:16.204231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 462/901] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:16 2022] DELETE /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:16.205793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:16.206412 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: c5ae47dd-c46e-4a26-9a32-b659fdebd24a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:16.213103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.213841 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.214274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.214965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.215410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.215828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.232794 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a HTTP/1.1 Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:52:16.234607 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.236660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'c5ae47dd-c46e-4a26-9a32-b659fdebd24a'} Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:16.237398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. Sep 07 14:52:16.238597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.239687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance c5ae47dd-c46e-4a26-9a32-b659fdebd24a could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:16.239687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-130061d2-51f5-444b-95c4-a0e876f0bda0 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a" status: 404 len: 111 microversion: 2.1 time: 0.034515 Sep 07 14:52:16.239687 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 440/902] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:16 2022] GET /compute/v2.1/servers/c5ae47dd-c46e-4a26-9a32-b659fdebd24a => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 14:52:16.245378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:16.245879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:16.252696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.253187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.253625 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.254326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.254781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.255250 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.272807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 HTTP/1.1 Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:52:16.274342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.275845 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '6cbc686c-776f-41cd-96ee-331395bc2204'} Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:16.276714 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.277942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.279205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:16.279205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-17aa3111-2dd8-4921-b220-64dfa52f7c42 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 404 len: 111 microversion: 2.1 time: 0.034750 Sep 07 14:52:16.279205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 463/903] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:16 2022] DELETE /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:16.286099 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:16.286801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: 6cbc686c-776f-41cd-96ee-331395bc2204] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:16.293065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.293626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.294129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.294921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.295457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.295955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.310513 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 HTTP/1.1 Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:52:16.312164 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.313801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '6cbc686c-776f-41cd-96ee-331395bc2204'} Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:16.314639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. Sep 07 14:52:16.316593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:16.317861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance 6cbc686c-776f-41cd-96ee-331395bc2204 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:16.317861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8473defe-dfaf-46fe-b427-953d41056828 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204" status: 404 len: 111 microversion: 2.1 time: 0.033105 Sep 07 14:52:16.317861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 441/904] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:16 2022] GET /compute/v2.1/servers/6cbc686c-776f-41cd-96ee-331395bc2204 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:16.675934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:16.676724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:16.682810 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.683294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.683764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.684456 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:16.684909 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:16.685331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:16.826042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:16.834722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:16.836215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:16.837413 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-77bdcf99-59a3-424f-9a73-0122404ef109 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.165954 Sep 07 14:52:16.837975 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 464/905] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:16 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:17.574418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:17.575198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:17.582248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.582730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.583348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:17.584053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.584528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.584950 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:17.599033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a HTTP/1.1 Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:52:17.600869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.602403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'be5f6be2-5405-4fec-9c2c-584b8e270d1a'} Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:17.603196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.604494 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.606107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:17.606107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c6708a8f-9b05-4c29-a2fd-a9e8da89b705 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 404 len: 111 microversion: 2.1 time: 0.031893 Sep 07 14:52:17.611091 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:17.611700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] [instance: be5f6be2-5405-4fec-9c2c-584b8e270d1a] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:17.615168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 442/906] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:17 2022] DELETE /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:17.618379 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.618943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.619450 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:17.620266 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.620786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.621277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:17.638184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] HTTP exception thrown: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Request method failure captured: Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a HTTP/1.1 Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6YUT9HbhG1IHOy4KLi3D5_v2ze164kcTAdfFgQ_K67XoTlKNugvY26ISNMWPDJbqNLk3YwbBr7iRhhrThKirf3L9LH1db8AVJDpS1_wAaHlMyecL5cUXGspbGhAROqIz9BgNgSuYWZTM7wRWV_2zuqPeO9BPJgIXv0LH8C_HCkxTA Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:52:17.641272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/e03d56845a594ecf9c320b2d70a633ca"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: e03d56845a594ecf9c320b2d70a633ca Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1475352578 Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 8eb5509df78d45acbebc332a889251dc Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeNegativeTest-1475352578-project Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.642838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'be5f6be2-5405-4fec-9c2c-584b8e270d1a'} Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:17.643588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. Sep 07 14:52:17.644821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:17.648017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] Returning 404 to user: Instance be5f6be2-5405-4fec-9c2c-584b8e270d1a could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:17.648017 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b51a601d-25c2-41f9-bb27-b852d3fca145 tempest-AttachVolumeNegativeTest-1475352578 tempest-AttachVolumeNegativeTest-1475352578-project] 10.222.0.57 "GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a" status: 404 len: 111 microversion: 2.1 time: 0.036514 Sep 07 14:52:17.648242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 465/907] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:17 2022] GET /compute/v2.1/servers/be5f6be2-5405-4fec-9c2c-584b8e270d1a => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:17.866267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:17.867337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:17.876185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.876903 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.877606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:17.878676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:17.879504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:17.880464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:18.056994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:18.067378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:18.068921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:18.070201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2fb5b1f7-e2e7-4d94-be72-96de990789ef tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.208854 Sep 07 14:52:18.071260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 443/908] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:17 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:19.096058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:19.096682 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:19.108969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:19.109488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:19.110123 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:19.110920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:19.111474 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:19.111946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:19.314128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:19.325335 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:19.327214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:19.329338 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2e2a70fc-29c1-4b20-a3cd-d7223304fe35 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.237117 Sep 07 14:52:19.350488 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 466/909] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:19 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:20.361168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:20.361807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:20.369817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:20.370309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:20.371015 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:20.371893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:20.372379 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:20.372870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:20.948588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:20.961259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:20.961259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:20.962349 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-698ea012-19a0-43ce-ae16-d60825ed6a2a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.604101 Sep 07 14:52:20.963266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 444/910] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:20 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:21.991348 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:21.992957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:22.002733 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:22.003467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:22.004206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:22.005108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:22.005798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:22.006421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:22.255837 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:22.264231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:22.266220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:22.267529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8f016260-c024-4f6d-8b16-f97fbe46f3a5 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.280896 Sep 07 14:52:22.268170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 467/911] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:21 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:23.293000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:23.293596 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:23.300742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:23.301218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:23.301648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:23.302333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:23.302779 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:23.303198 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:23.436463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:23.444830 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:23.446274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:23.447429 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c5bc0d4b-3664-43f2-9ebc-1537a492d349 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.158268 Sep 07 14:52:23.447988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 445/912] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:23 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:24.472449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:24.473066 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:24.479704 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:24.480213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:24.480657 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:24.481355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:24.481810 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:24.482231 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:24.621615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:24.630260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:24.633562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:24.633562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-60412157-3d3c-45bf-9c63-cd8f4332aa75 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.164352 Sep 07 14:52:24.633562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 468/913] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:24 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:25.659828 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:25.660622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:25.668196 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:25.669542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:25.670237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:25.671184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:25.671862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:25.672532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:25.808966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:25.817460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:25.818937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:25.820039 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4778ee53-96f6-4de0-94a4-6452fb712438 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.165181 Sep 07 14:52:25.820673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 446/914] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:25 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:26.845069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:26.845673 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:26.852223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:26.856303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:26.856303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:26.856303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:26.856303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:26.856716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:26.992922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:27.002315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:27.003751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:27.004936 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-aff80213-e87c-4412-817b-9b8b6205686a tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.163830 Sep 07 14:52:27.005490 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 469/915] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:26 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:27.258244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "name": "network-vif-plugged", "status": "completed", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:27.269935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:27.270726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:27.271243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:27.283734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] Creating event network-vif-plugged:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:52:27.289034 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-402e6435-2bdc-4f74-92f4-e0155f269992 req-d34a2cf6-44d5-4308-9b31-692d9c5500be service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035282 Sep 07 14:52:27.289884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 447/916] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:52:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:28.034840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:28.035445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:28.042048 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:28.042525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:28.042955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:28.043639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:28.044095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:28.044542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:28.179874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:28.189951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:28.191385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:28.192608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f18a8f00-de23-4c9f-b73e-27e0ce704fc7 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.161654 Sep 07 14:52:28.197428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 470/917] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:28 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:29.223451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:29.224397 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:29.231364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:29.231774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:29.232242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:29.232936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:29.233394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:29.233852 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:29.369778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:29.378582 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:29.380108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:29.381299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3ba2b568-d902-4175-9589-92c05792ff34 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.162857 Sep 07 14:52:29.381861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 448/918] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:29 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:30.407635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:30.408269 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:30.414739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:30.415356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:30.415819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:30.416525 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:30.416970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:30.417387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:30.554821 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:30.564464 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:30.566103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:30.567265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-63f8b0d1-6814-4e30-8a65-a8b26a1d4cad tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1730 microversion: 2.20 time: 0.163753 Sep 07 14:52:30.567964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 471/919] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:30 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1730 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:31.592213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:31.592871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:31.599604 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:31.600093 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:31.610753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:31.610753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:31.610753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:31.610753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:31.739347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:31.747562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:31.749033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:31.750213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e5ca16fc-d9d3-4902-869d-7f59096d10ca tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1717 microversion: 2.20 time: 0.162035 Sep 07 14:52:31.750774 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 449/920] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:52:31 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1717 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:52:34.220025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:34.220025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:34.225547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:34.226036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:34.226472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:34.227167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:34.227629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:34.228096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:34.255230 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:52:34.526277 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-89e93d18-96ca-489a-b073-c51ca3294a9a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 204 len: 0 microversion: 2.1 time: 0.311449 Sep 07 14:52:34.526883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 472/921] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:52:34 2022] DELETE /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:52:34.535658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:34.536313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:34.542655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:34.543144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:34.543583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:34.544305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:34.544763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:34.545189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:34.565696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:34.680122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:34.687806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b171c79a-f39a-4fa2-9a91-7fbdc2f7143f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1576 microversion: 2.1 time: 0.156475 Sep 07 14:52:34.688936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 450/922] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:34 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:35.713255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:35.713982 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:35.721191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:35.721669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:35.722102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:35.722786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:35.723259 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:35.723681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:35.861819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:35.869816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c0125566-0a88-4615-ba3f-391d2bbf868f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1576 microversion: 2.1 time: 0.160770 Sep 07 14:52:35.870385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 473/923] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:35 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:36.117176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:36.117701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:36.125032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:36.125519 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:36.126454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:36.127172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:36.127625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:36.128050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:36.151808 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eef54741-da8d-4e76-921b-fa8af8b5908d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/ips" status: 200 len: 145 microversion: 2.1 time: 0.038829 Sep 07 14:52:36.157113 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 451/924] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:52:36 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:52:36.893747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:36.901004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:36.901773 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:36.902266 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:36.902730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:36.903429 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:36.903885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:36.904418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:36.989798 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:36.997764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7b12b267-b1ea-4f2e-9e57-ed7ad61c479d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1508 microversion: 2.1 time: 0.107968 Sep 07 14:52:36.998339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 474/925] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:36 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1508 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:37.101679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9e91d7cf-ac5c-47f0-9b62-c666ce07c34b", "name": "network-vif-deleted", "tag": "bf8cc5d8-17e1-4be8-840a-eae77e5f2b80"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:37.112757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:37.113247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:37.113681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:37.125618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] Creating event network-vif-deleted:bf8cc5d8-17e1-4be8-840a-eae77e5f2b80 for instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b on hv-cinder-80135 Sep 07 14:52:37.131184 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-9bf30041-1493-49aa-9d26-7edeb3966cca req-eaaa10d4-9655-42c2-b37b-4ddfe4e8d1b4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033301 Sep 07 14:52:37.131792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 452/926] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:52:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:38.022451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:38.023264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:38.030042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:38.030529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:38.030965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:38.031666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:38.032173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:38.032612 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:38.095551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:38.103517 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cdc783d4-adfd-4f20-a5fb-4875a296a5ee tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1225 microversion: 2.1 time: 0.085432 Sep 07 14:52:38.104224 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 475/927] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:38 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:39.128257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:39.128966 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:39.135202 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:39.135685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:39.136122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:39.136832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:39.137288 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:39.137713 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:39.199046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:39.207284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-83bb917b-eb88-4ab9-ad78-7d4be47bb83d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1225 microversion: 2.1 time: 0.084432 Sep 07 14:52:39.207836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 453/928] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:39 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:40.230918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:40.231784 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:40.240431 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:40.240917 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:40.241355 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:40.242050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:40.242501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:40.242921 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:40.257662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:40.304997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:40.312639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a25a4b54-2bee-4d04-b02a-4022983f855e tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 200 len: 1225 microversion: 2.1 time: 0.086544 Sep 07 14:52:40.313227 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 476/929] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:40 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:40.531418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b715376b-c068-4b31-89a1-dafe9e410332"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:40.533792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:40.540440 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:40.540916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:40.541348 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:40.542029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:40.542478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:40.542916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:41.336197 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:41.336721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:41.343636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:41.344129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:41.344722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:41.345428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:41.345963 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:41.346396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:41.362695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] HTTP exception thrown: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Request method failure captured: Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b HTTP/1.1 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK9-os36cXsg_5C5A6zmIS72vkF-tX8Do_EgFYP9Oj-b-JsuJBa_kpXaKDE-9ggAqV03ll-AaMXjKtTgPlIp8-Fws1H_JkV-vcfsZODUaqTx8JmdgKPWVh8IYCJbcnR1atA5K83N59jBorEau7VeX_jNTB3Cy7DQuCaDX3YyIjwd-6k Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:52:41.365014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestVolumeBootPattern-741965744 Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2a6a637072b04667a3f21da9c57325c0 Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:52:41.366647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9e91d7cf-ac5c-47f0-9b62-c666ce07c34b'} Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:52:41.367961 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:52:41.369588 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:52:41.371049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Returning 404 to user: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:52:41.371049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-10a3ed3e-3583-4cc8-88ee-9fc78c376903 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 404 len: 111 microversion: 2.1 time: 0.034656 Sep 07 14:52:41.371049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 477/930] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:41 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:52:41.491043 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0bdc598a-ed6f-446e-8f87-b74a22755462 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.963228 Sep 07 14:52:41.491875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 454/931] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:52:40 2022] POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments => generated 194 bytes in 965 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:41.521721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-751836873", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-135479397", "security_groups": [{"name": "tempest-secgroup-smoke-1950875329"}], "block_device_mapping_v2": [{"uuid": "92725c2f-1527-4a26-980c-d4b4135bc870", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9357d86c-16cb-4519-9361-47152bec4c44"}]}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:41.641498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.network.neutron [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] validate_networks() for [('9357d86c-16cb-4519-9361-47152bec4c44', None, None, None, None, None)] {{(pid=127536) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:52:42.153301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:52:42.153732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image limits 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:52:42.154207 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:52:42.154620 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image pref 0:0:0 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:52:42.155034 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.virt.hardware [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127536) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:52:42.164035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:42.164547 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:42.164986 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:42.165716 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:42.166176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:42.166606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:42.183122 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:52:42.187078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for user 2a6a637072b04667a3f21da9c57325c0 and project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:52:42.244749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Going to run 1 instances... {{(pid=127536) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:52:42.246865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='92725c2f-1527-4a26-980c-d4b4135bc870',volume_size=None,volume_type=None)] {{(pid=127536) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:52:42.705754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f5233838-44c4-4b88-a82a-341513bee480 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.188692 Sep 07 14:52:42.707125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 478/932] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:52:41 2022] POST /compute/v2.1/servers => generated 406 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:52:42.719344 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0818010e-a267-443e-b2d0-bcfd15954457 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:42.720059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0818010e-a267-443e-b2d0-bcfd15954457 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:42.778146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0818010e-a267-443e-b2d0-bcfd15954457 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:42.786254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0818010e-a267-443e-b2d0-bcfd15954457 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1093 microversion: 2.1 time: 0.071687 Sep 07 14:52:42.786766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 455/933] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:42 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1093 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:43.808493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:43.809108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:43.816434 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:43.820418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:43.820418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:43.820418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:43.820418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:43.820797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:43.883150 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:43.890782 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-34f5051b-a17d-4101-9c20-a8f5bbe7cb6d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1143 microversion: 2.1 time: 0.086199 Sep 07 14:52:43.891329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 479/934] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:43 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1143 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:44.913974 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:44.914591 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:44.918282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=42 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:44.926867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:44.926867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:44.926867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:44.926867 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:44.927353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:44.927353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:44.991675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:44.999441 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6c3dd175-56ed-4a66-a3f0-347d4e696d26 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1191 microversion: 2.1 time: 0.089712 Sep 07 14:52:45.006883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 456/935] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:44 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1191 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:46.023027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:46.023652 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:46.029758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:46.030324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:46.031636 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:46.032363 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:46.032818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:46.033240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:46.276649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:46.284933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2a2be170-be1c-43fe-b2b0-ebc21b1dbacf tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.266247 Sep 07 14:52:46.286152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 480/936] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:46 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:47.182897 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431d0e2-c490-480a-ad68-6d1ea094bf1f", "tag": "e951d311-be74-4573-b4ad-1e6b298fdd52"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:47.193839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:47.194322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:47.194754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:47.207188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] Creating event network-changed:e951d311-be74-4573-b4ad-1e6b298fdd52 for instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f on hv-cinder-80135 Sep 07 14:52:47.213837 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-6fa697b9-8f82-48eb-ac90-28a0f808197f req-76a657f5-4d1a-492c-8586-7364016a4b37 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034033 Sep 07 14:52:47.215124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 457/937] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:52:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:52:47.308778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:47.309393 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:47.314557 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:47.317910 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:47.318391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:47.318814 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:47.319501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:47.320162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:47.320587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:47.541861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:47.549958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-05b17d6e-f5b4-441d-abee-7a411c569ed9 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.245340 Sep 07 14:52:47.550651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 481/938] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:47 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:48.574732 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:48.575437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:48.582049 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:48.583029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:48.583467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:48.584190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:48.584642 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:48.585072 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:48.717645 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:48.725778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-da8942c2-ad13-4192-9f17-e6313f79ed1c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.155208 Sep 07 14:52:48.726356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 458/939] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:48 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:49.749060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:49.749687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:49.757254 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:49.757741 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:49.758178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:49.758903 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:49.759363 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:49.759789 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:49.891281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:49.899318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4d95bf4-613e-4ae2-b3ea-47fcc399ffed tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.154258 Sep 07 14:52:49.899877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 482/940] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:49 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:50.921871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:50.922428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:50.929146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:50.929619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:50.930049 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:50.930728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:50.931174 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:50.931593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:51.125640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:51.134076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aff988e9-1ad7-4403-89d1-71df4b8dbe41 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.216108 Sep 07 14:52:51.134728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 459/941] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:50 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:52.157302 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:52.157912 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:52.165265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:52.165751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:52.166187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:52.166929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:52.167380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:52.167803 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:52.182819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:52.199800 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:52.237071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:52:52.244394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:52.245257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:52.245386 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:52.311289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Going to try to stop instance {{(pid=127537) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 14:52:52.535101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-62d0e52c-acbe-4086-a748-45290f6c6e47 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action" status: 202 len: 0 microversion: 2.1 time: 0.302221 Sep 07 14:52:52.535785 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 460/942] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:52:52 2022] POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:52:52.544538 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:52.545359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:52.551910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:52.552686 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:52.553189 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:52.554017 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:52.554526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:52.555033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:52.570605 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:52.578449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ef22c8f2-4ce9-4fa5-8f5d-01d05c833fb7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1277 microversion: 2.1 time: 0.425027 Sep 07 14:52:52.579005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 483/943] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:52 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1277 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:52.685991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:52.692076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7507e7fb-576e-45cc-b1da-31fc7d8c3fd4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.151417 Sep 07 14:52:52.692661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 461/944] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:52 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:53.602421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:53.603023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:53.609459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:53.609933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:53.610358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:53.611036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:53.611512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:53.611929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:53.718137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:53.718742 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:53.720763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:53.726647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:53.727137 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:53.736121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:53.736121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:53.736121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:53.736121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:53.745535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:53.753539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7e7e9f3f-6a65-41d7-80ea-83286859d0d5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.155556 Sep 07 14:52:53.754097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 484/945] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:53 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:53.864932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:53.873030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1cf1d125-1160-45cb-9b26-d26e13a589e8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.158675 Sep 07 14:52:53.873593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 462/946] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:53 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:54.778327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:54.779005 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:54.785627 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:54.786136 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:54.786574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:54.787267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:54.787727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:54.788181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:54.897997 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:54.898703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:54.905941 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:54.906426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:54.906861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:54.907559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:54.908008 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:54.908451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:54.918897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:54.926978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b93d3a89-3012-4f2d-aba8-542d9afcc45d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.152533 Sep 07 14:52:54.932237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 485/947] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:54 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:55.037734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:55.046090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2a4ddd17-a2b9-43fd-9823-cd31fd5360e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.152059 Sep 07 14:52:55.046708 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 463/948] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:54 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:55.949536 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:55.950140 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:55.956587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:55.957135 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:55.957604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:55.958295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:55.958749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:55.959171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:56.069994 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:56.070611 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:56.076964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:56.077472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:56.077907 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:56.078610 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:56.079061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:56.079484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:56.093698 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:56.101631 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-eecdd3ff-1e1f-4f95-b0cb-938deec1aea8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.155980 Sep 07 14:52:56.102204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 486/949] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:55 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:56.206002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:56.214256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-15c31722-5cb3-4cfa-b958-ef545919102f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.148696 Sep 07 14:52:56.214816 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 464/950] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:56 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:57.124984 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:57.125604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:57.132551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:57.133034 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:57.133472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:57.134162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:57.134622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:57.135049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:57.237735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:57.238330 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:57.244739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:57.245226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:57.245663 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:57.246363 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:57.246829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:57.247261 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:57.263046 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:57.271556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fe91bca1-0064-4428-88b3-94d971fbcf03 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.150417 Sep 07 14:52:57.272128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 487/951] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:57 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:57.378721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:57.387613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9f65145a-abf5-4c9f-843b-f8b5d9b1ba1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.153805 Sep 07 14:52:57.388200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 465/952] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:57 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:58.294537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:58.295182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:58.301848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:58.302340 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:58.302772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:58.303472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:58.303929 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:58.304385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:58.411622 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:58.412370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:58.418935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:58.419336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:58.419763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:58.420480 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:58.420934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:58.421355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:58.432349 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:58.440062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3be69ce2-3065-4d28-8185-c23a9e924bd2 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.149348 Sep 07 14:52:58.440926 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 488/953] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:58 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:58.552347 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:58.560984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0d0a7727-8fc1-41fd-94fd-dce33bc48c15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.154034 Sep 07 14:52:58.561589 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 466/954] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:58 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:52:59.463485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:59.464102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:59.470597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:59.475238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:59.475238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:59.475238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:59.475238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:59.475589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:59.585161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:52:59.585780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:52:59.592304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:59.592798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:59.593236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:59.593984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:52:59.594381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:52:59.594804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:52:59.609657 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:59.615789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:52:59.619543 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d77626ca-64f0-451f-80cc-0cfc36c20da3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.159896 Sep 07 14:52:59.620129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 489/955] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:59 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:52:59.722857 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:52:59.731207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5aa70b44-49df-4d9c-942d-68757c696495 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.149929 Sep 07 14:52:59.734624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 467/956] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:52:59 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:00.643105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:00.643706 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:00.650601 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:00.651076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:00.651503 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:00.652196 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:00.652645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:00.653063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:00.755522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:00.756218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:00.762749 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:00.763244 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:00.763691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:00.764427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:00.764886 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:00.765317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:00.785530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:00.793805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-521841ee-0385-49a9-b281-55fd35416977 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.154601 Sep 07 14:53:00.794387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 490/957] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:00 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:00.894450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:00.903490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c743f7ad-5e95-42da-b918-67b3c9d26b45 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.152248 Sep 07 14:53:00.904050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 468/958] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:00 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:01.816452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:01.817694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:01.824100 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:01.824622 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:01.825057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:01.825751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:01.826205 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:01.826630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:01.926935 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:01.928356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:01.935133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:01.935624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:01.936062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:01.936787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:01.937243 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:01.937674 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:01.959321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:01.967850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5431bf4b-1ec6-4d68-9e7c-3a5bf9594a7f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.155128 Sep 07 14:53:01.977930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 491/959] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:01 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:02.209423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:02.217684 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-96a73348-d487-4694-98ed-2696fc8549da tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.295054 Sep 07 14:53:02.218246 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 469/960] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:01 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:02.990905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:02.991521 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:02.998113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:03.002452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:03.002452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:03.002452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:03.002452 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:03.002865 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:03.131857 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:03.139510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2f803e46-4012-4c9b-ae9e-a6d48ace59c7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.152478 Sep 07 14:53:03.140070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 492/961] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:02 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:03.242257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:03.242782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:03.249135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:03.249617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:03.250056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:03.250770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:03.251233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:03.251655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:03.390818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:03.399570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9f623aa0-09ac-4842-ae7e-3d397d3fec12 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.161775 Sep 07 14:53:03.400120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 470/962] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:03 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:04.162792 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:04.163411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:04.169917 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:04.170567 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:04.170849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:04.171526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:04.171983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:04.172441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:04.305321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:04.314808 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-15bfe345-0c1d-43e9-9ec6-8a84bb9ff241 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.155918 Sep 07 14:53:04.315398 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 493/963] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:04 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:04.422413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:04.423055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:04.430266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:04.434226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:04.434226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:04.434226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:04.434226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:04.434615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:04.539828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431d0e2-c490-480a-ad68-6d1ea094bf1f", "name": "network-vif-plugged", "status": "completed", "tag": "e951d311-be74-4573-b4ad-1e6b298fdd52"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:04.549641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:04.550125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:04.550557 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:04.562151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] Creating event network-vif-plugged:e951d311-be74-4573-b4ad-1e6b298fdd52 for instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f on hv-cinder-80135 Sep 07 14:53:04.567193 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-e307e78c-0599-4aeb-8c3e-fc8a6f3924d9 req-53868a79-342a-46a6-96fb-39f3b6734834 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033066 Sep 07 14:53:04.567710 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 494/964] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:53:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:53:04.574625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:04.578834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0b9f745d-e246-4596-8b94-07de7d16d349 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.160362 Sep 07 14:53:04.579392 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 471/965] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:04 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:05.339885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:05.340604 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:05.346664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:05.350758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:05.350758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:05.350758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:05.350758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:05.351171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:05.351626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:05.483139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:05.491361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7bd5ce44-8d56-42a4-8d41-b5d2cce89243 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.156103 Sep 07 14:53:05.491950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 495/966] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:05 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:05.602140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:05.602786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:05.609257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:05.609744 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:05.610257 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:05.610951 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:05.611459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:05.611892 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:05.740911 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:05.749204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-feb156f7-9c4e-42f2-b8b5-24690e2e8f6f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.150930 Sep 07 14:53:05.751792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 472/967] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:05 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:06.515094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:06.515786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:06.522692 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:06.523180 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:06.523643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:06.524385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:06.524839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:06.525263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:06.658573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:06.667428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3b62ba87-0396-495f-a3a3-87fe5ceda1a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1265 microversion: 2.1 time: 0.156214 Sep 07 14:53:06.670545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 496/968] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:06 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:06.773334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:06.773953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:06.780540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:06.781025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:06.781469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:06.782259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:06.782714 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:06.783138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:06.920423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:06.928747 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-623c9d1b-987f-4a4e-bb04-a84a4ff6f897 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.159789 Sep 07 14:53:06.929301 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 473/969] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:06 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:07.691462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:07.692552 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:07.699315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.699801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.700264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:07.700969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.701427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.701855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:07.836869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:07.844761 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e6c33505-1413-4d8c-8d32-3b4ab4bce1a4 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1452 microversion: 2.1 time: 0.157313 Sep 07 14:53:07.845318 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 497/970] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:07 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:07.867020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:07.867629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:07.874038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.875926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.875926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:07.875926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.876256 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.876667 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:07.953372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:07.954237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:07.960371 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.964241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.964241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:07.964241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:07.964241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:07.964981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:08.066736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:08.075818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a1deb1df-0142-4803-9fe9-6bafb99ffbfd tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1452 microversion: 2.1 time: 0.212873 Sep 07 14:53:08.076472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 474/971] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:07 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1452 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:08.114770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:08.124946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-64df2d3d-c19d-485f-90bc-d97f05ed2330 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.176090 Sep 07 14:53:08.125528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 498/972] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:07 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:09.150922 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:09.152370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:09.160353 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:09.161853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:09.161853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:09.162760 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:09.163637 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:09.164069 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:09.343261 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:09.351498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1c2726fc-2f8e-4fc6-807c-72dad68452e3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.206530 Sep 07 14:53:09.352060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 475/973] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:09 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:10.074783 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:10.077051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:10.083493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.084001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.084464 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.085162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.085617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.086042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.115502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-43f06cce-66b6-4256-b460-459da8c34951 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044295 Sep 07 14:53:10.116088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 499/974] 10.222.0.57 () {60 vars in 1343 bytes} [Wed Sep 7 14:53:10 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:10.186506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:10.186992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:10.195134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.195626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.196067 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.196792 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.197253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.197678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.223579 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:53:10.298359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431d0e2-c490-480a-ad68-6d1ea094bf1f", "tag": "e951d311-be74-4573-b4ad-1e6b298fdd52"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:10.307743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.308261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.308771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.320385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] Creating event network-changed:e951d311-be74-4573-b4ad-1e6b298fdd52 for instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f on hv-cinder-80135 Sep 07 14:53:10.325577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-d155db75-1d80-4397-b05e-bb9ddbd509c9 req-89852700-23db-43dc-be18-57b8f2d00cd8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030926 Sep 07 14:53:10.326416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 500/975] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:53:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:53:10.376930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:10.378913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:10.389826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.394667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.394667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.394667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.395508 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.396478 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.565645 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-09f6316a-170f-4870-be5d-a17949683c6e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 204 len: 0 microversion: 2.20 time: 0.382694 Sep 07 14:53:10.567870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 476/976] 10.222.0.57 () {60 vars in 1280 bytes} [Wed Sep 7 14:53:10 2022] DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 07 14:53:10.580685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:10.582022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:10.588677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.589174 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.589615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.590526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:10.590986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:10.591416 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:10.615691 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:10.625258 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c843cb9c-5f66-4eab-9c2c-39ff18f827ce tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.254169 Sep 07 14:53:10.625847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 501/977] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:10 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:10.750427 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:10.759006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:10.760470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:10.761647 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b360c368-6bd0-4a97-9f4d-f86484aedd76 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.189335 Sep 07 14:53:10.762205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 477/978] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:10 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:53:11.649319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:11.650015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:11.656472 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:11.656965 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:11.657399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:11.658099 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:11.658553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:11.658987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:11.794893 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:11.795614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:11.802161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:11.802649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:11.803084 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:11.803775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:11.804255 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:11.804680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:11.808641 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:11.817201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e949392f-1484-4db7-9b79-0367bdff2de5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.172469 Sep 07 14:53:11.817779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 502/979] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:11 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:12.033556 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:12.046393 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:12.047977 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:12.049304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f9b92aad-dbc2-434a-87d8-6e0264047dbc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1723 microversion: 2.20 time: 0.258279 Sep 07 14:53:12.049942 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 478/980] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:11 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:53:12.841711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:12.842264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:12.849998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:12.850537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:12.850998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:12.851768 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:12.852285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:12.852728 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:13.020181 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:13.029816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7d47d375-78ed-43f7-aaf2-b3ff0b28c573 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1723 microversion: 2.1 time: 0.192157 Sep 07 14:53:13.030407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 503/981] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:12 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:13.081484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:13.082415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:13.094078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:13.094815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:13.095374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:13.096753 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:13.097323 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:13.099457 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:13.133772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cb4065a1-6ecd-4b81-9fee-b19edb507e3d", "name": "network-vif-deleted", "tag": "7d4f33de-d43c-423c-b4c2-827f4edc99f2"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:13.150309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:13.150811 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:13.151233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:13.169894 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] Creating event network-vif-deleted:7d4f33de-d43c-423c-b4c2-827f4edc99f2 for instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d on hv-cinder-80135 Sep 07 14:53:13.175237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-fd4177ad-cbfa-442b-bbce-6df5f0cba3cf req-b59e1931-5583-4381-87a2-d35925b85310 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046057 Sep 07 14:53:13.175753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 504/982] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:53:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:13.183614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:13.192501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:13.195296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:13.196101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6d69ba12-b789-4dbc-b9f8-9276c1e0bbd4 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1656 microversion: 2.20 time: 0.124203 Sep 07 14:53:13.196843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 479/983] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:13 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1656 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 07 14:53:14.055840 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:14.057727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:14.081468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.081964 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.082403 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.083183 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.084212 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.084592 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.222564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:14.223299 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:14.230510 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.231143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.231847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.232810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.233259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.233848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.243163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:14.253328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1e1483a3-7963-499c-a8bc-48fbc510b43f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1700 microversion: 2.1 time: 0.203288 Sep 07 14:53:14.253788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 505/984] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:14 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1700 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:14.274207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.275114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.275114 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.275557 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lazy-loading 'fault' on Instance uuid cb4065a1-6ecd-4b81-9fee-b19edb507e3d {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:53:14.282050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:14.289013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.289614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.290106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.345233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:14.352539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:14.354032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'eeab924bf7a646779b48f57f14710e05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fa5b6b66febc4070a509feee0b0838f6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:14.355205 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-62736d76-98a6-495e-b65a-dd8a787be35e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 200 len: 1372 microversion: 2.20 time: 0.136602 Sep 07 14:53:14.356130 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 480/985] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:14 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 1372 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 07 14:53:14.358274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Going to try to start instance {{(pid=127536) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 14:53:14.500959 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-53a432ef-563d-4891-864a-3e1b286a2d70 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action" status: 202 len: 0 microversion: 2.1 time: 0.222431 Sep 07 14:53:14.501638 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 506/986] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:53:14 2022] POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action => generated 0 bytes in 224 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:53:14.514332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:14.514332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:14.517505 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.518060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.518514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.519252 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:14.519758 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:14.520240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:14.663848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:14.673572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9b8df560-0041-4fc3-a9f9-50a08b4ba74e tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1709 microversion: 2.1 time: 0.166708 Sep 07 14:53:14.674222 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 481/987] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:14 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:15.384004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:15.384676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:15.390919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:15.391395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:15.391819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:15.392530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:15.392979 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:15.393409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:15.407486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d HTTP/1.1 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:15.409162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:15.410860 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'cb4065a1-6ecd-4b81-9fee-b19edb507e3d'} Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:15.411849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:15.413442 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:15.414825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:15.414825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-41cf0288-d9cb-4631-a789-5626e0a82bc2 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 404 len: 111 microversion: 2.20 time: 0.031823 Sep 07 14:53:15.414825 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 507/988] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:15 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:53:15.419623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8a74277a-aa7a-4e32-9485-cad40243d001 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '.version_select at 0x7fefdf8484c0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:15.487961 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8a74277a-aa7a-4e32-9485-cad40243d001 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332131323" status: 204 len: 0 microversion: 2.20 time: 0.072257 Sep 07 14:53:15.488576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 482/989] 10.222.0.57 () {60 vars in 1262 bytes} [Wed Sep 7 14:53:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1332131323 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 07 14:53:15.697004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:15.702412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:15.704923 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:15.705418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:15.705853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:15.706771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:15.707006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:15.707485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:15.856010 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:15.866529 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1b27fb2b-a586-4366-92fa-ad7761198701 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1709 microversion: 2.1 time: 0.173216 Sep 07 14:53:15.867102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 508/990] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:15 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1709 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:16.890999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:16.891592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:16.899569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:16.901738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:16.901738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:16.901738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:16.901738 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:16.902190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:16.906632 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:17.037264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:17.046965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0e1c9d26-8aca-4b5d-9606-20c695040280 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1713 microversion: 2.1 time: 0.160387 Sep 07 14:53:17.047602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 483/991] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:16 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1713 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:17.520725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:17.521542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:17.528771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:17.529432 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:17.529957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:17.530699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:17.531164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:17.531595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:17.545483 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d HTTP/1.1 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:17.547036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.548807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'cb4065a1-6ecd-4b81-9fee-b19edb507e3d'} Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:17.549720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.551265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.553365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:17.553365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e9a01654-ad0c-4a62-81cb-909245325161 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 404 len: 111 microversion: 2.20 time: 0.031533 Sep 07 14:53:17.553365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 509/992] 10.222.0.57 () {60 vars in 1280 bytes} [Wed Sep 7 14:53:17 2022] DELETE /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:53:17.557629 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:17.558322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: cb4065a1-6ecd-4b81-9fee-b19edb507e3d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:17.560750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=64,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:17.565580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:17.566060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:17.566500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:17.567190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:17.567846 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:17.569247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:17.583548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d HTTP/1.1 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:17.586414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.588162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'cb4065a1-6ecd-4b81-9fee-b19edb507e3d'} Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:17.589231 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. Sep 07 14:53:17.590678 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:17.591770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance cb4065a1-6ecd-4b81-9fee-b19edb507e3d could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:17.591770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-78b7011a-12fa-4dc7-9f68-913402cb661e tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d" status: 404 len: 111 microversion: 2.20 time: 0.034761 Sep 07 14:53:17.591770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 484/993] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:17 2022] GET /compute/v2.1/servers/cb4065a1-6ecd-4b81-9fee-b19edb507e3d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 14:53:18.857293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:18.857850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:18.865931 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:18.866485 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:18.867103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:18.867775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:18.868457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:18.868948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:18.884241 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d HTTP/1.1 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:18.885812 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.887492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d'} Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:18.888449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.894152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.895418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:18.895418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7bf4afd4-c5d2-4168-bf08-a50c66922903 tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 404 len: 111 microversion: 2.20 time: 0.034169 Sep 07 14:53:18.895418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 510/994] 10.222.0.57 () {60 vars in 1280 bytes} [Wed Sep 7 14:53:18 2022] DELETE /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 07 14:53:18.901972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:18.903119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] [instance: ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:18.910247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:18.910929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:18.911532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:18.912602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:18.913056 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:18.913474 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:18.929541 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] HTTP exception thrown: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Request method failure captured: Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d HTTP/1.1 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK6cU1u1QDGWUVuiW863TOqj30_4wDnYI4bhjd2uk6D4bVWlVZwhT1DarrqgnZ5BmgDDRX0v4EqTgtt8ZTs-1YOy402FmqFXeWje1ozTFTnFWmb2yhwNDT86Zd0YODtO9ViKzSHnoY76gYy3VWHwZ4KTbK3N1RCIlNSIRMOpbBy6KJE Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Openstack-Nova-Api-Version: 2.20 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:18.931462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/fa5b6b66febc4070a509feee0b0838f6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: fa5b6b66febc4070a509feee0b0838f6 Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1706929608 Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: eeab924bf7a646779b48f57f14710e05 Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1706929608-project Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.933152 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d'} Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:18.933949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. Sep 07 14:53:18.935168 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:18.936279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] Returning 404 to user: Instance ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:18.936617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1aa8a96c-3283-43ad-93e8-ed83842db1bc tempest-AttachVolumeShelveTestJSON-1706929608 tempest-AttachVolumeShelveTestJSON-1706929608-project] 10.222.0.57 "GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d" status: 404 len: 111 microversion: 2.20 time: 0.038469 Sep 07 14:53:18.937143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 485/995] 10.222.0.57 () {60 vars in 1277 bytes} [Wed Sep 7 14:53:18 2022] GET /compute/v2.1/servers/ecb6a6c2-a9d4-44ed-90ad-1980df2cf47d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:53:24.647944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e98e55cb-1446-4567-adf8-2d10879e292d tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Action: 'create', calling method: .version_select at 0x7fefdf7e5430>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-950562685"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:25.230148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e98e55cb-1446-4567-adf8-2d10879e292d tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 0.701035 Sep 07 14:53:25.230777 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 511/996] 10.222.0.57 () {60 vars in 1155 bytes} [Wed Sep 7 14:53:24 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 702 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 14:53:25.243834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9463122c-fd72-486d-a68e-e77d2dc06d7c tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf8478b0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:25.292563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9463122c-fd72-486d-a68e-e77d2dc06d7c tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 200 len: 344 microversion: 2.1 time: 0.052735 Sep 07 14:53:25.293313 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 486/997] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:25 2022] GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:26.308042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e3f67cc6-0882-4aa7-b779-751a6955c3f8 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf844550>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:26.357056 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e3f67cc6-0882-4aa7-b779-751a6955c3f8 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 200 len: 345 microversion: 2.1 time: 0.053924 Sep 07 14:53:26.357617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 512/998] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:26 2022] GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 345 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:26.371921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9467026a-5170-44f8-a238-641528ba7a26 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Action: 'create', calling method: .version_select at 0x7fefdf85e4c0>, body: {"snapshot": {"volume_id": "9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1391273245"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:26.802405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9467026a-5170-44f8-a238-641528ba7a26 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.435120 Sep 07 14:53:26.802989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 487/999] 10.222.0.57 () {60 vars in 1162 bytes} [Wed Sep 7 14:53:26 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:26.816991 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-43867c25-edff-4549-b1d8-b400b550fdea tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdfd83ca0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:26.844160 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-43867c25-edff-4549-b1d8-b400b550fdea tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.033521 Sep 07 14:53:26.844817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 513/1000] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:26 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:26.856584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-dca9c363-ed2f-472c-a27f-69e6155000a6 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf85ea60>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:26.887927 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-dca9c363-ed2f-472c-a27f-69e6155000a6 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035149 Sep 07 14:53:26.888586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 488/1001] 10.222.0.57 () {58 vars in 1140 bytes} [Wed Sep 7 14:53:26 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:26.900844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0aeacfe6-0111-492b-845a-4b432a419b8f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf7c8280>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:26.929538 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0aeacfe6-0111-492b-845a-4b432a419b8f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.033545 Sep 07 14:53:26.930106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 514/1002] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:26 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:27.942365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d5e0fdc6-9eb1-44ed-826c-c579bcb66d10 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf82f5e0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:27.977690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d5e0fdc6-9eb1-44ed-826c-c579bcb66d10 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.039664 Sep 07 14:53:27.978262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 489/1003] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:27 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:28.987850 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=59 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:28.988907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:28.992469 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-648cb937-f6be-44f8-a198-97964cb67766 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf855c10>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:29.022356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-648cb937-f6be-44f8-a198-97964cb67766 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.034951 Sep 07 14:53:29.027380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 515/1004] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:28 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:30.033599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=8 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:30.038555 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-448bcf75-df7a-4487-be2d-688ff7db1ab4 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf8a29d0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:30.067690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-448bcf75-df7a-4487-be2d-688ff7db1ab4 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.034713 Sep 07 14:53:30.068268 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 490/1005] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:30 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:31.081471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-057e4629-6428-486f-8939-ffb99744c750 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdfd83ca0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:31.110573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-057e4629-6428-486f-8939-ffb99744c750 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 288 microversion: 2.1 time: 0.034081 Sep 07 14:53:31.111149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 516/1006] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:31 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 288 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:31.123539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d3607640-3b72-4402-95fa-1ce3145e3eba tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf9448b0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:31.296700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d3607640-3b72-4402-95fa-1ce3145e3eba tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "DELETE /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 202 len: 0 microversion: 2.1 time: 0.177643 Sep 07 14:53:31.297332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 491/1007] 10.222.0.57 () {58 vars in 1254 bytes} [Wed Sep 7 14:53:31 2022] DELETE /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:53:31.306126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4bce25e8-796f-4945-a2bd-5b294f51130a tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf7e59d0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:31.337833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4bce25e8-796f-4945-a2bd-5b294f51130a tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 200 len: 287 microversion: 2.1 time: 0.036022 Sep 07 14:53:31.338403 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 517/1008] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:31 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:31.713804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:31.714455 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:31.720783 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:31.721250 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:31.721679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:31.722365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:31.722810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:31.723227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:31.746755 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lazy-loading 'flavor' on Instance uuid 2281b075-fc96-43fb-b309-ad45a0c42bac {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:53:32.019901 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-15c442d4-2d25-46d4-b54e-8c95ab0e8ce0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "POST /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac/action" status: 202 len: 0 microversion: 2.1 time: 0.312180 Sep 07 14:53:32.020551 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 492/1009] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:53:31 2022] POST /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:53:32.029522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:32.030168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:32.037312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:32.037791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:32.038770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:32.039655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:32.040111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:32.040639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:32.181002 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:32.189540 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f2eb2b6f-3d4b-4771-b499-e94530b048e5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.163848 Sep 07 14:53:32.190098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 518/1010] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:32 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:32.351559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cfaba1ea-5802-4ee2-a126-924e0dc45128 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf8474c0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:32.376439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-cfaba1ea-5802-4ee2-a126-924e0dc45128 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] HTTP exception thrown: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cfaba1ea-5802-4ee2-a126-924e0dc45128 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Request method failure captured: Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e HTTP/1.1 Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLBk2Unj5bDtRY1DJtaMskpShwrj7b9V6tZo1VzVLQp1Q0xGOzc6vTGqAmUpNY4xd7rDt6r8rV14MDaoPZ16MFmUrPdsDMRCexz1k_Bj8fK8onsvRFgbTpV3pfwknb1ewf9u7e5FDNxpkuUYNZYLJ4gKbgIdIE0PJtGQbuZk6VGNYUI Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:32.379639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9193c2d554e649d280251ad312e94ead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9193c2d554e649d280251ad312e94ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 2084397f6d9a4416a53c225a13e025e6 Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'fe209183-4a35-48ed-ada6-d748850a897e'} Sep 07 14:53:32.381201 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. (HTTP 404) (Request-ID: req-c4da5b73-06b7-4a7c-b371-423f6acc1ae7) Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.382609 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:32.383832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 07 14:53:32.385118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-cfaba1ea-5802-4ee2-a126-924e0dc45128 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Returning 404 to user: Snapshot fe209183-4a35-48ed-ada6-d748850a897e could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:32.386406 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-cfaba1ea-5802-4ee2-a126-924e0dc45128 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e" status: 404 len: 111 microversion: 2.1 time: 0.034276 Sep 07 14:53:32.387270 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 493/1011] 10.222.0.57 () {58 vars in 1251 bytes} [Wed Sep 7 14:53:32 2022] GET /compute/v2.1/os-snapshots/fe209183-4a35-48ed-ada6-d748850a897e => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:32.390819 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-773183fe-b3bd-4632-8e93-ed6979aacbf2 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdfd48310>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:32.575201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-773183fe-b3bd-4632-8e93-ed6979aacbf2 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 202 len: 0 microversion: 2.1 time: 0.188504 Sep 07 14:53:32.575799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 519/1012] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:53:32 2022] DELETE /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:53:32.586526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7af62f64-5d78-4f86-9f26-58b875e56181 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefe3126670>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:32.633405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7af62f64-5d78-4f86-9f26-58b875e56181 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 200 len: 344 microversion: 2.1 time: 0.052985 Sep 07 14:53:32.633968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 494/1013] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:32 2022] GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 344 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:33.214952 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:33.215586 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:33.221558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:33.222036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:33.222470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:33.223155 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:33.223606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:33.224030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:33.358235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:33.366009 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-59201e41-6f14-4cc8-8100-8a835f0b7149 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.156051 Sep 07 14:53:33.368332 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 520/1014] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:33 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:33.648896 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f7a0bd6-1cd8-40ec-bb49-0af8c5de225e tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf96e820>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:33.684426 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-5f7a0bd6-1cd8-40ec-bb49-0af8c5de225e tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] HTTP exception thrown: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f7a0bd6-1cd8-40ec-bb49-0af8c5de225e tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Request method failure captured: Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 HTTP/1.1 Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLBk2Unj5bDtRY1DJtaMskpShwrj7b9V6tZo1VzVLQp1Q0xGOzc6vTGqAmUpNY4xd7rDt6r8rV14MDaoPZ16MFmUrPdsDMRCexz1k_Bj8fK8onsvRFgbTpV3pfwknb1ewf9u7e5FDNxpkuUYNZYLJ4gKbgIdIE0PJtGQbuZk6VGNYUI Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:33.685112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9193c2d554e649d280251ad312e94ead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9193c2d554e649d280251ad312e94ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 2084397f6d9a4416a53c225a13e025e6 Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1'} Sep 07 14:53:33.686699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. (HTTP 404) (Request-ID: req-733327b7-f80d-4dea-932e-f9e437c78ff4) Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.687876 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:33.689456 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 14:53:33.692751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f7a0bd6-1cd8-40ec-bb49-0af8c5de225e tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Returning 404 to user: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f7a0bd6-1cd8-40ec-bb49-0af8c5de225e tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 404 len: 109 microversion: 2.1 time: 0.042423 Sep 07 14:53:33.694193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 495/1015] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:33 2022] GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 109 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:33.696663 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c3256ab-0a49-4523-bcdd-4400ef794224 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf855ee0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:33.727904 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-1c3256ab-0a49-4523-bcdd-4400ef794224 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] HTTP exception thrown: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c3256ab-0a49-4523-bcdd-4400ef794224 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Request method failure captured: Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 HTTP/1.1 Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLBk2Unj5bDtRY1DJtaMskpShwrj7b9V6tZo1VzVLQp1Q0xGOzc6vTGqAmUpNY4xd7rDt6r8rV14MDaoPZ16MFmUrPdsDMRCexz1k_Bj8fK8onsvRFgbTpV3pfwknb1ewf9u7e5FDNxpkuUYNZYLJ4gKbgIdIE0PJtGQbuZk6VGNYUI Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:33.731303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9193c2d554e649d280251ad312e94ead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9193c2d554e649d280251ad312e94ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2084397f6d9a4416a53c225a13e025e6 Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1'} Sep 07 14:53:33.733043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. (HTTP 404) (Request-ID: req-33ab7bcf-a189-48ef-a469-828bc5dbf074) Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.734036 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:33.736106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 14:53:33.738551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1c3256ab-0a49-4523-bcdd-4400ef794224 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Returning 404 to user: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:33.740755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1c3256ab-0a49-4523-bcdd-4400ef794224 tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 404 len: 109 microversion: 2.1 time: 0.040097 Sep 07 14:53:33.743950 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 521/1016] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:53:33 2022] DELETE /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:33.744053 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b4cf9a8a-54bd-4310-9358-47747b79995f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Calling method '.version_select at 0x7fefdf904940>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:33.776369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-b4cf9a8a-54bd-4310-9358-47747b79995f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] HTTP exception thrown: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b4cf9a8a-54bd-4310-9358-47747b79995f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Request method failure captured: Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 HTTP/1.1 Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLBk2Unj5bDtRY1DJtaMskpShwrj7b9V6tZo1VzVLQp1Q0xGOzc6vTGqAmUpNY4xd7rDt6r8rV14MDaoPZ16MFmUrPdsDMRCexz1k_Bj8fK8onsvRFgbTpV3pfwknb1ewf9u7e5FDNxpkuUYNZYLJ4gKbgIdIE0PJtGQbuZk6VGNYUI Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:33.777968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_9193c2d554e649d280251ad312e94ead"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/9193c2d554e649d280251ad312e94ead"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/9193c2d554e649d280251ad312e94ead"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 9193c2d554e649d280251ad312e94ead Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1854267499 Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 2084397f6d9a4416a53c225a13e025e6 Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1854267499-project Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1'} Sep 07 14:53:33.779545 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. (HTTP 404) (Request-ID: req-334f7c64-b55f-493a-ad05-cbfa59728606) Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.780558 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:33.781984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 14:53:33.783289 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b4cf9a8a-54bd-4310-9358-47747b79995f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] Returning 404 to user: Volume 9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b4cf9a8a-54bd-4310-9358-47747b79995f tempest-VolumesSnapshotsTestJSON-1854267499 tempest-VolumesSnapshotsTestJSON-1854267499-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1" status: 404 len: 109 microversion: 2.1 time: 0.041443 Sep 07 14:53:33.792389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 496/1017] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:33 2022] GET /compute/v2.1/os-volumes/9ef8e49f-c8df-4bfe-bb1b-eb80b843d4c1 => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 07 14:53:34.390425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:34.391223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:34.400440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:34.401273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:34.401918 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:34.402843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:34.403577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:34.404271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:34.562670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:34.571115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-5618b08c-7772-4b63-ac72-39f4897bbf66 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.184680 Sep 07 14:53:34.571682 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 522/1018] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:34 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:35.595281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:35.596016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:35.602942 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:35.603540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:35.603873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:35.604597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:35.605055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:35.605484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:35.743371 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:35.751163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6e2737e7-940f-4cc5-97d5-9029890655de tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.160506 Sep 07 14:53:35.751722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 497/1019] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:35 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:36.107394 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-aa9bc202-cec0-4890-9346-fdf8031ee8d1 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Action: 'create', calling method: .version_select at 0x7fefdf844040>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1467378199", "metadata": {"Type": "work"}}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:36.721460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-aa9bc202-cec0-4890-9346-fdf8031ee8d1 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.792876 Sep 07 14:53:36.722116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 523/1020] 10.222.0.57 () {60 vars in 1156 bytes} [Wed Sep 7 14:53:35 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 794 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 07 14:53:36.735854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3850049c-b11a-4dad-9930-62c43873d4f9 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf8488b0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:36.775818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:36.775818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:36.783166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:36.783667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:36.784111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:36.784848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:36.785311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:36.785735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:36.793005 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3850049c-b11a-4dad-9930-62c43873d4f9 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 200 len: 353 microversion: 2.1 time: 0.060947 Sep 07 14:53:36.793570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 498/1021] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:36 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:36.918372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:36.926268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7776c29c-3a61-4293-8773-3dc505c8abc9 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.155357 Sep 07 14:53:36.926894 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 524/1022] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:36 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:37.808375 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e8935d43-6e9c-4cb1-b6e0-70e38e864619 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf8475e0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:37.854397 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e8935d43-6e9c-4cb1-b6e0-70e38e864619 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 200 len: 353 microversion: 2.1 time: 0.050868 Sep 07 14:53:37.854959 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 499/1023] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:37 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:37.950617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:37.951229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:37.957545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:37.958025 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:37.958458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:37.959139 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:37.959591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:37.960013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:38.092707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:38.101072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7ce20965-1ddf-40ad-b7c8-a6500263415f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.153730 Sep 07 14:53:38.104026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 525/1024] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:37 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:38.870567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-de12bfa1-cd81-44e7-9a12-a6b390c659d2 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf8b1c10>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:38.917022 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-de12bfa1-cd81-44e7-9a12-a6b390c659d2 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 200 len: 354 microversion: 2.1 time: 0.051980 Sep 07 14:53:38.917788 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 500/1025] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:38 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:38.931145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fa72e466-2870-4ccd-bf2e-3bfc16b388ad tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf8a5af0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:38.980313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fa72e466-2870-4ccd-bf2e-3bfc16b388ad tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 200 len: 354 microversion: 2.1 time: 0.053502 Sep 07 14:53:38.980890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 526/1026] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:38 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 354 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:38.993889 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d6d17c39-1e8a-451c-8706-0bd3b6f27367 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf847670>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:39.126901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:39.127755 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:39.135297 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:39.135981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:39.136462 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:39.137151 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:39.137608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:39.138031 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:39.201531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d6d17c39-1e8a-451c-8706-0bd3b6f27367 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 202 len: 0 microversion: 2.1 time: 0.211313 Sep 07 14:53:39.202260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 501/1027] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:53:38 2022] DELETE /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 0 bytes in 213 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:53:39.211094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f12d0308-2498-42a2-b91b-299b4f2cd4a5 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf8c7670>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:39.260987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f12d0308-2498-42a2-b91b-299b4f2cd4a5 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 200 len: 353 microversion: 2.1 time: 0.053852 Sep 07 14:53:39.261151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 502/1028] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:39 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 353 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:53:39.278347 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:39.286038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fb1f53c9-f7aa-4cdc-9ab2-b302888b05a1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.164061 Sep 07 14:53:39.289600 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 527/1029] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:39 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:40.275550 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8327620d-989c-4b6e-b1c0-506887b72b21 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Calling method '.version_select at 0x7fefdf944310>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:40.303466 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-8327620d-989c-4b6e-b1c0-506887b72b21 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] HTTP exception thrown: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8327620d-989c-4b6e-b1c0-506887b72b21 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Request method failure captured: Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 HTTP/1.1 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLBveZTjQerc2cVjScJcKo8SP47gBX7Ru_bQZynYFQNVIwPx_RQ5gVL-VxajXWN1_-YoBlEM9yHFac1tuk4lHp6UTEdE_7b9no3CapuKRZ-A_caC2romLENdYagUkSAPmtVjl8aG7qgENXkOIep_wWvI4uQVth0LgDBuRIE6JODwvhY Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: ef1179ff1a1a4b73bc5af5b756aa8777 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesGetTestJSON-1174031370 Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:40.306025 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_ef1179ff1a1a4b73bc5af5b756aa8777"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef1179ff1a1a4b73bc5af5b756aa8777"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/ef1179ff1a1a4b73bc5af5b756aa8777"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/ef1179ff1a1a4b73bc5af5b756aa8777"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesGetTestJSON-1174031370 Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: ef1179ff1a1a4b73bc5af5b756aa8777 Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesGetTestJSON-1174031370 Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesGetTestJSON-1174031370-project Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: bf248baa83064fe5979a372ff726b8b3 Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesGetTestJSON-1174031370-project Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '0325692d-90bb-44bd-b157-e4bf2122e284'} Sep 07 14:53:40.307418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. (HTTP 404) (Request-ID: req-46625fa6-4a92-42b8-bb95-83d6f3ff7268) Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:40.308316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:40.309526 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 14:53:40.310690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8327620d-989c-4b6e-b1c0-506887b72b21 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] Returning 404 to user: Volume 0325692d-90bb-44bd-b157-e4bf2122e284 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8327620d-989c-4b6e-b1c0-506887b72b21 tempest-VolumesGetTestJSON-1174031370 tempest-VolumesGetTestJSON-1174031370-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284" status: 404 len: 109 microversion: 2.1 time: 0.036594 Sep 07 14:53:40.311931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 503/1030] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:40 2022] GET /compute/v2.1/os-volumes/0325692d-90bb-44bd-b157-e4bf2122e284 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:40.314367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:40.314367 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:40.318497 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:40.318992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:40.319433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:40.320743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:40.321213 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:40.321696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:40.455271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:40.464337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b247012d-6ef0-4448-adf0-b5559dd6d24c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.156838 Sep 07 14:53:40.464907 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 528/1031] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:40 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:41.487875 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:41.488514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:41.494568 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:41.496054 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:41.496054 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:41.496305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:41.496679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:41.497098 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:41.638861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:41.647294 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-41c69ae5-4ede-4fbc-aa5a-509a503b143b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.163871 Sep 07 14:53:41.648068 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 504/1032] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:41 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:42.409178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-49f5eb8d-4a46-4910-89ce-850488e6b2ae tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Action: 'create', calling method: .version_select at 0x7fefdf74c160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-363890949", "metadata": {"Type": "work"}}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-49f5eb8d-4a46-4910-89ce-850488e6b2ae tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 121 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:42.421145 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-363890949", "metadata": {"Type": "work"}}} Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: Sep 07 14:53:42.422752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-363890949', 'metadata': {'Type': 'work'}}}} Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise error Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi '#$%' Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.423804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 14:53:42.425694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 14:53:42.427014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 07 14:53:42.427014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.427014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-49f5eb8d-4a46-4910-89ce-850488e6b2ae tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.427014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-49f5eb8d-4a46-4910-89ce-850488e6b2ae tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.124297 Sep 07 14:53:42.427014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 529/1033] 10.222.0.57 () {60 vars in 1156 bytes} [Wed Sep 7 14:53:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 125 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 07 14:53:42.432621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3c9728a8-264a-40b0-a49f-89b1f893a1b1 tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Action: 'create', calling method: .version_select at 0x7fefe3126280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-733100274", "metadata": {"Type": "work"}}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3c9728a8-264a-40b0-a49f-89b1f893a1b1 tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 119 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:42.437210 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-733100274", "metadata": {"Type": "work"}}} Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:42.438845 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-733100274', 'metadata': {'Type': 'work'}}}} Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise error Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi '0' Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.439906 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 14:53:42.441588 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 14:53:42.442926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 07 14:53:42.442926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.442926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3c9728a8-264a-40b0-a49f-89b1f893a1b1 tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.442926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3c9728a8-264a-40b0-a49f-89b1f893a1b1 tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.010301 Sep 07 14:53:42.442926 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 505/1034] 10.222.0.57 () {60 vars in 1156 bytes} [Wed Sep 7 14:53:42 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:53:42.447987 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d36efc80-39c9-4379-99fc-121803c5abad tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Action: 'create', calling method: .version_select at 0x7fefdf8659d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-647270772", "metadata": {"Type": "work"}}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d36efc80-39c9-4379-99fc-121803c5abad tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 118 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:42.451786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-647270772", "metadata": {"Type": "work"}}} Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: Sep 07 14:53:42.453385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-647270772', 'metadata': {'Type': 'work'}}}} Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise error Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi '' Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.454345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 07 14:53:42.456176 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 07 14:53:42.457775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 07 14:53:42.457775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.457775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d36efc80-39c9-4379-99fc-121803c5abad tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.457775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d36efc80-39c9-4379-99fc-121803c5abad tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.010036 Sep 07 14:53:42.457775 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 530/1035] 10.222.0.57 () {60 vars in 1156 bytes} [Wed Sep 7 14:53:42 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 12 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 07 14:53:42.463118 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7e8f6360-cb1f-4bf0-bd9a-acc6742cce4d tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Calling method '.version_select at 0x7fefdf904820>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:42.491136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-7e8f6360-cb1f-4bf0-bd9a-acc6742cce4d tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] HTTP exception thrown: Volume tempest-invalid-921961266 could not be found. Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7e8f6360-cb1f-4bf0-bd9a-acc6742cce4d tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-921961266 HTTP/1.1 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:42.493592 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Volume tempest-invalid-921961266 could not be found. Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'tempest-invalid-921961266'} Sep 07 14:53:42.495227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-921961266 could not be found. (HTTP 404) (Request-ID: req-4f8c17a0-e6df-4a1c-9363-67526539bce2) Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.496236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:42.497436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-921961266 could not be found. Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:42.498599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-921961266 could not be found. Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-921961266 could not be found. Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7e8f6360-cb1f-4bf0-bd9a-acc6742cce4d tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 404 to user: Volume tempest-invalid-921961266 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7e8f6360-cb1f-4bf0-bd9a-acc6742cce4d tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/tempest-invalid-921961266" status: 404 len: 98 microversion: 2.1 time: 0.035570 Sep 07 14:53:42.499839 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 506/1036] 10.222.0.57 () {58 vars in 1215 bytes} [Wed Sep 7 14:53:42 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-921961266 => generated 98 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 07 14:53:42.505556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b48082c9-3c78-4065-970d-c1f68c77c72e tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003653 Sep 07 14:53:42.506051 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 531/1037] 10.222.0.57 () {58 vars in 1140 bytes} [Wed Sep 7 14:53:42 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 14:53:42.515097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a2f1a439-7246-456f-acca-15c9452b9a2f tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003647 Sep 07 14:53:42.515613 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 507/1038] 10.222.0.57 () {58 vars in 1137 bytes} [Wed Sep 7 14:53:42 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 07 14:53:42.523771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cf70b49b-5cfe-4817-809c-35090572313b tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Calling method '.version_select at 0x7fefdf7c81f0>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:42.551301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-cf70b49b-5cfe-4817-809c-35090572313b tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] HTTP exception thrown: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cf70b49b-5cfe-4817-809c-35090572313b tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/os-volumes/71ee9dc9-94d8-4a4d-9a90-facf65bcc254 HTTP/1.1 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:53:42.553299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '71ee9dc9-94d8-4a4d-9a90-facf65bcc254'} Sep 07 14:53:42.555484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. (HTTP 404) (Request-ID: req-edce1309-aa07-4660-af23-1bce2513f106) Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.556470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 07 14:53:42.557913 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 07 14:53:42.559611 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cf70b49b-5cfe-4817-809c-35090572313b tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 404 to user: Volume 71ee9dc9-94d8-4a4d-9a90-facf65bcc254 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cf70b49b-5cfe-4817-809c-35090572313b tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "DELETE /compute/v2.1/os-volumes/71ee9dc9-94d8-4a4d-9a90-facf65bcc254" status: 404 len: 109 microversion: 2.1 time: 0.035285 Sep 07 14:53:42.561050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 532/1039] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:53:42 2022] DELETE /compute/v2.1/os-volumes/71ee9dc9-94d8-4a4d-9a90-facf65bcc254 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:42.564942 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-760a0f85-2bda-4620-9e21-999bb32743fb tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Calling method '.version_select at 0x7fefdf848790>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:42.592826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-760a0f85-2bda-4620-9e21-999bb32743fb tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] HTTP exception thrown: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-760a0f85-2bda-4620-9e21-999bb32743fb tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Request method failure captured: Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/os-volumes/f5b794fc-68dc-42b7-90c7-75e831f74516 HTTP/1.1 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGLB2u2tMe0rqndtc5EF9_Y2zwd1M3-F0aL5Z4Y2D6cekrapcB4Mp_9Ve3PGkcjmYq4K-8FUvD4aBfF3j-WGPmA7B7l0jzAfXN6SggD5lr2CatfCJnVD8vHaeo0AdBTiSSBVNheV9g7XyfpvFotuCjYTASsJh0_CJcFzDAwZ2y4QjoIw Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:53:42.594765 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/8d4bd5d1e14c4f9fab898d5a16fbc962"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 8d4bd5d1e14c4f9fab898d5a16fbc962 Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-VolumesNegativeTest-932575836 Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6899a6ebd0a349c7a20fcf2170f6c24a Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-VolumesNegativeTest-932575836-project Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': 'f5b794fc-68dc-42b7-90c7-75e831f74516'} Sep 07 14:53:42.596336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. (HTTP 404) (Request-ID: req-f4434db2-ff5b-41f6-ad3d-82a99f613ed2) Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.606424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 07 14:53:42.608207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 07 14:53:42.609575 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-760a0f85-2bda-4620-9e21-999bb32743fb tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] Returning 404 to user: Volume f5b794fc-68dc-42b7-90c7-75e831f74516 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-760a0f85-2bda-4620-9e21-999bb32743fb tempest-VolumesNegativeTest-932575836 tempest-VolumesNegativeTest-932575836-project] 10.222.0.57 "GET /compute/v2.1/os-volumes/f5b794fc-68dc-42b7-90c7-75e831f74516" status: 404 len: 109 microversion: 2.1 time: 0.034923 Sep 07 14:53:42.610979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 508/1040] 10.222.0.57 () {58 vars in 1245 bytes} [Wed Sep 7 14:53:42 2022] GET /compute/v2.1/os-volumes/f5b794fc-68dc-42b7-90c7-75e831f74516 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:53:42.670727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:42.671298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:42.678073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:42.678629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:42.679008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:42.680320 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:42.680781 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:42.681206 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:42.822589 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:42.830461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8c974abf-8a96-4a76-b336-07f0c3b593f0 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.163675 Sep 07 14:53:42.831020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 533/1041] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:42 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:43.855010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:43.855691 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:43.861849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:43.862332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:43.862869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:43.863562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:43.864016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:43.864470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:44.012258 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:44.022171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c4318c27-5c1e-4b0c-96a4-28a1eba85970 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.171493 Sep 07 14:53:44.022651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 509/1042] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:43 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:45.045637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:45.046306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:45.052783 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:45.053270 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:45.053705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:45.054409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:45.054866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:45.055282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:45.196194 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:45.204486 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c1da3c6-937a-44c5-b5e7-0a9161a1fb0a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.162951 Sep 07 14:53:45.205057 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 534/1043] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:45 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:46.228581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:46.229838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:46.245057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:46.245057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:46.245057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:46.245057 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:46.245658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:46.245658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:46.375221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:46.383151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8474479c-bd4b-4284-8ddc-71c58fef2521 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.159689 Sep 07 14:53:46.383698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 510/1044] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:46 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:47.406869 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:47.408890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:47.414970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:47.415458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:47.415891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:47.416645 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:47.417103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:47.417524 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:47.553883 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:47.561801 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a8eeb5fe-fbe6-4b1d-9ff1-1ca7dc9d71d6 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.158983 Sep 07 14:53:47.571726 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 535/1045] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:47 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:48.584927 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:48.585641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:48.592064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:48.592651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:48.593027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:48.593735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:48.594190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:48.594619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:48.757581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:48.765631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7a3b2759-d6f3-4fd4-92e3-8d4cc11ea290 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.184395 Sep 07 14:53:48.766203 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 511/1046] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:48 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:49.789717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:49.790336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:49.796792 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:49.797274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:49.797705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:49.798425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:49.798839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:49.799262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:49.939011 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:49.947416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-80fa718f-f21e-446c-92fa-9b2c15f050a3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.161596 Sep 07 14:53:49.948101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 536/1047] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:49 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:50.978583 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:50.979207 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:50.985633 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:50.986156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:50.986612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:50.987296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:50.987756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:50.988359 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:51.159248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:51.167428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9880ec04-ebb9-4b20-9a98-1932c1856f03 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.197794 Sep 07 14:53:51.168001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 512/1048] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:50 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:52.190713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:52.191329 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:52.199646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:52.200165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:52.200582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:52.201283 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:52.201735 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:52.202160 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:52.355295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:52.363560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d5e8d0de-c5f7-4538-8270-b5b22a69b754 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.176512 Sep 07 14:53:52.364060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 537/1049] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:52 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:53.386883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:53.387503 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:53.394121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:53.394530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:53.394981 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:53.395669 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:53.396129 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:53.396862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:53.529932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:53.537835 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1a2be76a-dfac-4e88-b534-051add4d30c1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1568 microversion: 2.1 time: 0.154782 Sep 07 14:53:53.538396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 513/1050] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:53 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:53.562629 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:53.563274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:53.570098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:53.575233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:53.575233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:53.575233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:53.575233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:53.576327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:53.620240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=127536) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 07 14:53:54.051468 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-452dd35b-6751-408f-b934-06c3e496dad3 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "POST /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac/action" status: 202 len: 0 microversion: 2.1 time: 0.494018 Sep 07 14:53:54.052074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 538/1051] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:53:53 2022] POST /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac/action => generated 0 bytes in 495 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:53:54.060173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:54.061054 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:54.067437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:54.075967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:54.076451 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:54.081960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:54.081960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:54.081960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:54.279233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:54.289195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f35fb05e-a3b3-4b25-aef7-df0f074268d7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1516 microversion: 2.1 time: 0.232084 Sep 07 14:53:54.289778 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 514/1052] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:54 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:55.318823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:55.319545 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:55.327043 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:55.328114 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:55.328934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:55.331063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:55.331063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:55.331438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:55.533166 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:55.542568 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-03b8305a-026d-4a7a-8615-a2dbd73eabb5 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1516 microversion: 2.1 time: 0.230061 Sep 07 14:53:55.546035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 539/1053] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:55 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1516 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:56.570384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:56.571001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:56.573615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=22 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:56.579861 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:56.580420 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:56.580895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:56.581795 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:56.582242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:56.582693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:56.818304 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:56.831006 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-76c86fda-05f5-4739-8ee9-efddf0ec2219 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1518 microversion: 2.1 time: 0.264845 Sep 07 14:53:56.832446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 515/1054] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:56 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1518 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:53:57.030398 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "name": "network-vif-unplugged", "status": "completed", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:53:57.047672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:57.048470 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:57.049016 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:57.081282 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] Creating event network-vif-unplugged:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:53:57.087430 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-3a43bc20-5927-43b1-86bd-7382ecfbbe6d req-96851e42-3702-47ff-874f-67080b860162 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.065300 Sep 07 14:53:57.088565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 540/1055] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:53:57 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:53:57.711155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:57.712121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:57.725133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:57.728107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:57.729062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:57.732334 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:57.732819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:57.733260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:57.837548 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lazy-loading 'services' on Instance uuid 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:53:57.861172 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:57.862159 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:57.874615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:57.875809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:57.876463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:57.877535 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:57.878158 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:57.878754 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:58.030862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:58.040778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c90f4fde-7f2a-4128-9672-4441fc56ad9b tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.188306 Sep 07 14:53:58.042752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 541/1056] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:57 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:53:58.068051 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eb855456-759f-4f4d-980d-eaa6072ece77 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments/b715376b-c068-4b31-89a1-dafe9e410332" status: 202 len: 0 microversion: 2.1 time: 0.365156 Sep 07 14:53:58.068834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 516/1057] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:53:57 2022] DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments/b715376b-c068-4b31-89a1-dafe9e410332 => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:53:59.069720 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:53:59.071428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:53:59.078433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:59.078934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:59.079372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:59.080081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:53:59.080571 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:53:59.080991 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:53:59.104460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:53:59.323023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:53:59.332745 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b7374c78-d7bb-4556-8c14-ff69ea61323d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.267017 Sep 07 14:53:59.333333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 542/1058] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:53:59 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:00.340527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:00.352936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:00.353476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:00.353921 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:00.361440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:00.362118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:00.370504 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:00.370995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:00.371418 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:00.372333 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:00.373094 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:00.379484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:00.379634 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Going to try to stop instance {{(pid=127537) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 07 14:54:00.582884 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:00.592614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9f550b6d-5591-4297-82a5-1a97b6cc9899 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.235684 Sep 07 14:54:00.593842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 543/1059] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:00 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:00.611218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f480757-39bb-4da9-a1de-a26ab33647c4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action" status: 202 len: 0 microversion: 2.1 time: 0.275888 Sep 07 14:54:00.612332 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 517/1060] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:54:00 2022] POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:54:00.620847 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:00.621978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:00.629660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:00.630558 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:00.631526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:00.633120 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:00.634170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:00.642201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:00.819129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:00.831437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b3cf95a0-172f-4127-8c66-874f2aae93f4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.214830 Sep 07 14:54:00.833374 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 544/1061] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:00 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:01.620376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:01.623999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:01.633913 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:01.634662 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:01.635308 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:01.636206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:01.637133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:01.637999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:01.666401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:01.856541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:01.857163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:01.859710 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=43,nova_api:UPDATE=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:01.867289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:01.869310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:01.869958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:01.870839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:01.877530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:01.877530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:01.917110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:01.927216 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-c2a00a63-4b98-4c28-8895-c4649cd91581 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.314176 Sep 07 14:54:01.928312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 518/1062] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:01 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:02.194008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:02.202888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b05cec93-8d74-4339-9d10-7fed96a243a9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.350595 Sep 07 14:54:02.204330 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 545/1063] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:01 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:02.951996 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:02.953059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:02.959784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:02.960972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:02.961355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:02.962062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:02.962572 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:02.962949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:03.218050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:03.229109 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-da5be678-77a6-4209-bbf1-fef1c6bf3ea1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.281485 Sep 07 14:54:03.229342 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:03.229772 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:03.233150 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 519/1064] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:02 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:03.246275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:03.248358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:03.249596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:03.254725 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:03.255498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:03.255942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:03.490076 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:03.498357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9ff47f27-36ce-4cba-9cbc-11ac0415e0a0 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.274829 Sep 07 14:54:03.499203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 546/1065] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:03 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:04.253282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:04.254798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:04.262159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:04.262750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:04.263423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:04.264460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:04.265160 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:04.265851 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:04.523324 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:04.525854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:04.533672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:04.534484 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:04.535148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:04.536089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:04.537248 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:04.537905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:04.699355 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:04.707336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-676e8681-de9c-4855-9a5c-9f2ee68db140 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.457959 Sep 07 14:54:04.707912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 520/1066] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:04 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:04.773606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:04.781559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ce32ef5f-f6fa-421d-9516-f95e08c3eba6 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.263754 Sep 07 14:54:04.782152 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 547/1067] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:04 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:05.733540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:05.734395 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:05.741396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:05.744968 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:05.745818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:05.746624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:05.747163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:05.747692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:05.809004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:05.810013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:05.819997 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:05.824399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:05.824399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:05.824399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:05.824399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:05.825007 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:06.111717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:06.121868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9ca0137d-68ab-47d8-b08d-5312aed60c32 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.393950 Sep 07 14:54:06.122602 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 521/1068] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:05 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:06.136381 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:06.145157 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a4245f19-827b-4444-8c76-6d0f0e1ae17d tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.342626 Sep 07 14:54:06.146006 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 548/1069] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:05 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:07.147340 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:07.149407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:07.159570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:07.160333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:07.162060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:07.162990 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:07.172748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:07.180171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:07.180459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:07.180459 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:07.195597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:07.196118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:07.196791 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:07.199395 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:07.199862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:07.200339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:07.416381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:07.420278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:07.432473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a355e022-d9b5-4f60-88bd-ecbd973be6bc tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.290633 Sep 07 14:54:07.444311 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 522/1070] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:07 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:07.444960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-1493b41c-5d03-4bfb-aca9-fa3bd8e19d90 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.268713 Sep 07 14:54:07.444960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 549/1071] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:07 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:08.468675 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:08.469706 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:08.472276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:08.475053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:08.490329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:08.493100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:08.493839 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:08.494646 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:08.495458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:08.498606 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:08.499279 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:08.500780 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:08.501587 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:08.502679 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:08.503163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:08.517830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:08.798156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:08.808050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-93fae150-5b6a-455a-923c-558bbdea9c1b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.351107 Sep 07 14:54:08.808946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 550/1072] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:08 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:08.824273 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "name": "network-vif-plugged", "status": "completed", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:08.837970 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:08.847797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:08.847797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:08.870643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:08.878743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] Creating event network-vif-plugged:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:54:08.886070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a68434ff-0f00-4b1e-af11-36887422d045 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.432356 Sep 07 14:54:08.888218 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 523/1073] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:08 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:08.892103 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-99e145ce-5c0c-44d7-9298-2b433ac611af req-1ca13f02-1d80-462c-b929-045d4d6dd1ee service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.081534 Sep 07 14:54:08.893042 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 551/1074] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:54:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:54:09.832799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:09.834125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:09.844872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:09.850175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:09.850175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:09.850175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:09.850175 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:09.850603 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:09.918980 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:09.920126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:09.932516 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:09.935805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:09.936301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:09.937039 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:09.937556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:09.937992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:10.027020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:10.037061 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-571c64ea-a7df-4e31-97be-4c36c1540b65 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.208005 Sep 07 14:54:10.038293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 524/1075] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:09 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:10.143802 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:10.152816 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cb00c6af-41fd-4522-8625-e56170623cb7 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1574 microversion: 2.1 time: 0.238487 Sep 07 14:54:10.167278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 552/1076] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:09 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1574 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:11.060854 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:11.061469 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:11.067954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:11.068463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:11.068900 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:11.070173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:11.070624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:11.072267 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:11.183020 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:11.187762 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:11.196855 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:11.197363 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:11.200220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:11.216608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:11.217439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:11.218378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:11.307039 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:11.322219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-51ca87d7-aa51-47cd-afbc-35645f6c9030 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1677 microversion: 2.1 time: 0.261273 Sep 07 14:54:11.332552 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 525/1077] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:11 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1677 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:11.462565 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:11.473608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6ff18a09-09e1-4bd1-9c8f-f14cb9f6819f tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1561 microversion: 2.1 time: 0.297006 Sep 07 14:54:11.475375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 553/1078] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:11 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1561 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:12.345730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:12.346546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:12.354414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:12.357631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:12.358437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:12.359553 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:12.360136 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:12.360701 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:12.587514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:12.596717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0e1cc5e2-3371-47da-aeb0-bd6dca105704 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1654 microversion: 2.1 time: 0.254788 Sep 07 14:54:12.597949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 526/1079] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:12 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1654 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:12.620596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:12.628530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:12.629311 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:12.629928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:12.654915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Going to try to start instance {{(pid=127536) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 07 14:54:12.881870 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d99abaa2-6503-4253-9fa2-4c46de9a837f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action" status: 202 len: 0 microversion: 2.1 time: 0.265258 Sep 07 14:54:12.893843 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:12.894856 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:12.896321 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 554/1080] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:54:12 2022] POST /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/action => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:54:12.909925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:12.910696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:12.911306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:12.913881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:12.914571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:12.918253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:13.105848 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:13.113802 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7efa17f1-3c01-497e-9c28-c7e16095fe97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1663 microversion: 2.1 time: 0.226059 Sep 07 14:54:13.114378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 527/1081] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:12 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1663 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:14.141560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:14.141560 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:14.155200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:14.156054 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:14.158690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:14.158690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:14.164699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:14.165316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:14.340325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:14.348072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-edad8d80-1faf-4b11-9cff-fe401aff7c22 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1663 microversion: 2.1 time: 0.214343 Sep 07 14:54:14.348662 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 555/1082] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:14 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1663 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:15.371734 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:15.373100 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:15.381958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:15.383013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:15.384943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:15.385958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:15.386902 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:15.387706 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:15.551516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:15.560115 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-50900b1b-58ee-43dc-b370-5e6287fc5fa1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1667 microversion: 2.1 time: 0.192866 Sep 07 14:54:15.560787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 528/1083] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:15 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1667 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:18.885758 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-8355815a-b84b-4204-8b3c-9dbd64927922 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'create', calling method: .version_select at 0x7fefdf969f70>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-253911819", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDB9dbnLtOiy2Ntt3f6B3/upUz08SgU4a+xpKKObrV54cR/eRQ57gC9gpL6gCbPT4jk/CGBnJ54l3mW8n0fra2XUPmXr9BRxZjx3luUTxoh5Saw9GqXKY6AdIYaVhr+0+A=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:18.904448 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-8355815a-b84b-4204-8b3c-9dbd64927922 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Getting quotas for project 2710cdaf256342faae76fd5451ed432b. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:54:18.908439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-8355815a-b84b-4204-8b3c-9dbd64927922 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Getting quotas for user c18dbeea047a4505b2d5417dc54e8cb4 and project 2710cdaf256342faae76fd5451ed432b. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:54:18.985128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-8355815a-b84b-4204-8b3c-9dbd64927922 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.103816 Sep 07 14:54:18.989237 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 556/1084] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:54:18 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:54:19.095316 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1459910954", "imageRef": "59105443-ff37-40be-b406-5da1b38a3e7c", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-253911819", "networks": [{"uuid": "5e5e930f-ca7f-4b9b-8d15-0f90a886d2e3"}]}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:19.153985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] validate_networks() for [('5e5e930f-ca7f-4b9b-8d15-0f90a886d2e3', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:54:19.537683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:54:19.538949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:54:19.544111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:54:19.544111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:54:19.544111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:54:19.549763 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:19.550237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:19.550666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:19.551383 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:19.551829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:19.552278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:19.569735 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Getting quotas for project 2710cdaf256342faae76fd5451ed432b. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:54:19.574524 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Getting quotas for user c18dbeea047a4505b2d5417dc54e8cb4 and project 2710cdaf256342faae76fd5451ed432b. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:54:19.586356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:54:19.588695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='59105443-ff37-40be-b406-5da1b38a3e7c',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:54:19.750871 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-111f5d92-12f5-4a1f-9afb-a46a804dd369 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.659304 Sep 07 14:54:19.751433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 529/1085] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:54:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 661 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:54:19.762476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e2544821-93a8-4bb7-80f0-5da76b6f7eb7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:19.763109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e2544821-93a8-4bb7-80f0-5da76b6f7eb7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:19.825933 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e2544821-93a8-4bb7-80f0-5da76b6f7eb7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:19.835216 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e2544821-93a8-4bb7-80f0-5da76b6f7eb7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1258 microversion: 2.1 time: 0.075991 Sep 07 14:54:19.835917 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 557/1086] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:19 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:20.861065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4fc86027-9485-4caa-abe4-68c872384b14 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:20.861809 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4fc86027-9485-4caa-abe4-68c872384b14 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:20.928046 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4fc86027-9485-4caa-abe4-68c872384b14 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:20.935868 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4fc86027-9485-4caa-abe4-68c872384b14 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1258 microversion: 2.1 time: 0.079170 Sep 07 14:54:20.936522 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 530/1087] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:20 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1258 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:21.958746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:21.959365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:21.967861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:21.968392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:21.968830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:21.969528 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:21.970165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:21.970401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:22.032121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:22.040722 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4620899-a7c7-4c9e-abc7-4cf9623ecdf4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1310 microversion: 2.1 time: 0.085881 Sep 07 14:54:22.041286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 558/1088] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:21 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1310 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:23.062948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:23.065234 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:23.072382 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:23.072862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:23.073487 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:23.074368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:23.074983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:23.075725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:23.227932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:23.236543 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0455337d-747f-4cab-a3ae-a5d8f2b34fd1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.177393 Sep 07 14:54:23.237325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 531/1089] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:23 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:24.265503 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:24.266049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:24.274173 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:24.274919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:24.275358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:24.276071 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:24.276554 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:24.276983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:24.300477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:24.314651 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:24.315506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:24.316180 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:24.346829 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] Creating event network-changed:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:54:24.353085 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-e9ad28f8-02ff-4c53-acdf-793e52597ecc req-6cc80447-f117-4ad2-a8fd-07ec87d64da7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056487 Sep 07 14:54:24.354570 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 532/1090] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:54:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:54:24.432361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:24.442405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-649f2923-85db-4add-8af4-b072eb624e66 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.179091 Sep 07 14:54:24.443098 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 559/1091] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:24 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:25.465713 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:25.466414 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:25.473064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:25.473577 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:25.474013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:25.474804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:25.475342 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:25.475782 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:25.611317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:25.619593 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8c65924a-dafc-44e4-bf6d-b148ffef767d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.158215 Sep 07 14:54:25.620188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 533/1092] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:25 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:26.642797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:26.643416 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:26.650110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:26.650610 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:26.652299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:26.652299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:26.652299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:26.652642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:26.673411 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:26.794621 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:26.804209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-556d4339-edaa-46f7-95e0-d93be590998d tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.164603 Sep 07 14:54:26.804956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 560/1093] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:26 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:27.828640 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:27.829232 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:27.831677 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:27.837172 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:27.837665 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:27.838106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:27.838817 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:27.839271 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:27.839693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:27.988741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:27.996673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-435e8049-b17c-4e3f-96b9-28b9964bcd02 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.171816 Sep 07 14:54:27.997472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 534/1094] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:27 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:29.019409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:29.020182 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:29.027550 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:29.028045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:29.028534 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:29.029239 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:29.029688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:29.030267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:29.174542 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:29.183441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-29149b83-629e-440d-8a12-691ff7cac19c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.168224 Sep 07 14:54:29.198661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 561/1095] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:29 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:30.207155 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:30.207905 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:30.210278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:30.215330 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:30.215824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:30.216317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:30.217029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:30.217599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:30.217973 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:30.359146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:30.367958 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d57dde40-e974-4954-a42a-2bfb0fa25d64 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.165308 Sep 07 14:54:30.384686 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 535/1096] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:30 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:31.391405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:31.392189 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:31.395363 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=6 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:31.400327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:31.401300 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:31.402022 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:31.402998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:31.403794 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:31.404417 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:31.581359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:31.601985 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-13c77150-85a6-4df6-bf47-164a404f612a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.214529 Sep 07 14:54:31.602750 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 562/1097] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:31 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:32.625223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:32.625840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:32.628020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=8 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:32.634054 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:32.634539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:32.634979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:32.635807 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:32.636292 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:32.636745 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:32.769242 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:32.778351 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a0315776-59e0-4673-80cf-66ecc314f3b7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.157279 Sep 07 14:54:32.778910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 536/1098] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:32 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:33.800438 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:33.801081 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:33.804598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:33.809389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:33.809874 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:33.810313 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:33.811004 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:33.811460 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:33.811888 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:33.939028 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:33.946807 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4e042a64-c0bb-47c6-a7f0-d0dedaf4690b tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.150341 Sep 07 14:54:33.951510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 563/1099] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:33 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:34.969815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:34.970441 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:34.977147 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:34.977639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:34.978080 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:34.978789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:34.979247 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:34.979675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:34.982360 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=100 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:35.115123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:35.124746 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6d696021-1962-4094-aad7-e3abfebd816c tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.159048 Sep 07 14:54:35.125324 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 537/1100] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:34 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:36.151654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:36.152290 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:36.158603 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:36.159073 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:36.159499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:36.160198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:36.160649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:36.161067 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:36.288312 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:36.295921 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-692998a9-ef60-4af1-9d8c-c3fa85fa5c78 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.149028 Sep 07 14:54:36.296532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 564/1101] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:36 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:37.318401 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:37.319542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:37.325532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:37.326003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:37.326430 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:37.327107 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:37.327554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:37.327974 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:37.454433 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:37.462754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-63b0f49a-6bb5-45bf-9ac7-c2bdb12e7d53 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.148387 Sep 07 14:54:37.463309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 538/1102] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:37 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:38.484786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:38.485391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:38.491830 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:38.492347 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:38.492778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:38.493453 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:38.493895 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:38.494309 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:38.620639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:38.628211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ecbaa390-e1d7-40ff-8f20-52989208eae3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.147126 Sep 07 14:54:38.628778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 565/1103] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:38 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:39.650001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:39.650656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:39.657020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:39.657505 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:39.657947 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:39.658649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:39.659104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:39.659532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:39.788065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:39.796035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-65446bda-7a4e-458b-8845-70b5cbed5f70 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.150080 Sep 07 14:54:39.796631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 539/1104] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:39 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:40.820853 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:40.821506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:40.827891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:40.831898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:40.831898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:40.831898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:40.831898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:40.832293 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:40.963939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:40.965590 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "name": "network-vif-plugged", "status": "completed", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:40.975744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-22af5a9c-dbb8-46bd-a9cc-3d3d8d5f7734 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.157879 Sep 07 14:54:40.979803 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:40.980201 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 566/1105] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:40 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:40.980322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:40.980322 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:40.988626 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] Creating event network-vif-plugged:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:54:40.994133 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-0a62baed-cd02-4dc7-9b5c-175529a7b261 req-2fed1043-4bbc-461f-8acb-1def3c6d17f7 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033561 Sep 07 14:54:40.994707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 540/1106] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:54:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:54:41.998705 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:41.999316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:42.005881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:42.006387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:42.006827 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:42.007518 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:42.007969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:42.008424 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:42.134951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:42.142639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b20ef22f-46ec-4b92-9de4-16f15b965b8f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.147909 Sep 07 14:54:42.143209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 567/1107] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:41 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:43.166806 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:43.167515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:43.173730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:43.174230 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:43.174675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:43.175367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:43.175824 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:43.176275 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:43.302766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:43.310937 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7b6615be-a18a-4aad-bf73-0fc520dfe14f tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.148970 Sep 07 14:54:43.311493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 541/1108] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:43 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:44.335041 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:44.335654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:44.342171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:44.342651 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:44.343080 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:44.343765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:44.344236 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:44.344659 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:44.473334 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:44.480992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ac31b3c0-4e86-4012-a7ed-4a8bdb6664a4 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.150415 Sep 07 14:54:44.481573 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 568/1109] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:44 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:45.503916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:45.504564 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:45.511111 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:45.511658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:45.512090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:45.512804 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:45.513261 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:45.513690 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:45.645485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:45.654079 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e85273f2-aeee-41bd-a547-e94a2fb6dad3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1358 microversion: 2.1 time: 0.154022 Sep 07 14:54:45.654648 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 542/1110] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:45 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:54:46.677038 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:46.677617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:46.684690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:46.685165 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:46.685597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:46.686275 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:46.686721 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:46.687133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:46.822574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:46.831482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-573e395f-34ad-4157-9140-022a2a1d77ab tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1547 microversion: 2.1 time: 0.158484 Sep 07 14:54:46.833096 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 569/1111] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:46 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1547 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:46.855228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:46.855844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:46.862239 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:46.865035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:46.865035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:46.865035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:46.865035 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:46.867269 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:46.992532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:47.000282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-22d69022-248a-41ab-8464-7aa0e688b37a tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1547 microversion: 2.1 time: 0.148860 Sep 07 14:54:47.000842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 543/1112] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:46 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:47.022559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:47.027548 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:47.028378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Searching by: {'deleted': False, 'project_id': '2710cdaf256342faae76fd5451ed432b'} {{(pid=127536) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 07 14:54:47.034981 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:47.035457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:47.035890 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:47.036693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:47.037162 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:47.038296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:47.135440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.multi_cell_list [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=127536) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 07 14:54:47.231566 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e3762845-36fc-4360-b192-9abaeac3e2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.213374 Sep 07 14:54:47.232078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 570/1113] 10.222.0.57 () {58 vars in 1125 bytes} [Wed Sep 7 14:54:47 2022] GET /compute/v2.1/servers => generated 343 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:54:47.243527 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:47.244169 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:47.250073 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:47.250561 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:47.251002 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:47.251722 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:47.252206 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:47.252643 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:47.380618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:47.389407 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f365c506-6aca-4847-8099-f839cd36d578 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1547 microversion: 2.1 time: 0.149561 Sep 07 14:54:47.389918 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 544/1114] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:47 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:54:49.494599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f85baab4-ff8d-47a6-b88d-bc1d38670ddb"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:49.496967 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:49.503343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:49.503826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:49.504294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:49.504994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:49.505451 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:49.505905 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:50.198939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cb1c1c7b-95ba-42e8-a0e8-c0e8c8cd1ae1 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.708670 Sep 07 14:54:50.199669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 571/1115] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:54:49 2022] POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments => generated 194 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:54:57.897762 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-911542674", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-135479397", "security_groups": [{"name": "tempest-secgroup-smoke-1950875329"}], "block_device_mapping_v2": [{"uuid": "6711ac16-fafe-4be2-86a7-23b70580e118", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9357d86c-16cb-4519-9361-47152bec4c44"}]}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:54:57.908576 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=21 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:57.909236 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=43 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:58.012026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] validate_networks() for [('9357d86c-16cb-4519-9361-47152bec4c44', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:54:58.376786 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:54:58.377276 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:54:58.377814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:54:58.378318 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:54:58.378819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:54:58.387567 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:58.388042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:58.388509 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:58.389229 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:54:58.389680 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:54:58.390121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:54:58.406621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:54:58.410631 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Getting quotas for user 2a6a637072b04667a3f21da9c57325c0 and project 5c7b26a4966c4c309d058d1d19d5d553. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:54:58.468082 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:54:58.470217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6711ac16-fafe-4be2-86a7-23b70580e118',volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:54:58.899955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-39d890e6-c42e-40aa-bdf8-a0cd7cbd5ca3 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.006263 Sep 07 14:54:58.901827 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 545/1116] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:54:57 2022] POST /compute/v2.1/servers => generated 406 bytes in 1008 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:54:58.920360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-916effab-e11e-485e-8456-50291a6774a6 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:54:58.920360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-916effab-e11e-485e-8456-50291a6774a6 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:54:58.920360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:54:58.986121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-916effab-e11e-485e-8456-50291a6774a6 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:54:58.993901 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-916effab-e11e-485e-8456-50291a6774a6 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1093 microversion: 2.1 time: 0.085583 Sep 07 14:54:58.994623 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 572/1117] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:54:58 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1093 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:00.017862 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:00.018491 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:00.026185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:00.026681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:00.028789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:00.028789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:00.028789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:00.028789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:00.108725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:00.117284 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f2e05495-39c3-49f1-a5f7-95d7758605fa tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1143 microversion: 2.1 time: 0.104148 Sep 07 14:55:00.118955 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 546/1118] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:00 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1143 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:01.079730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:01.080377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:01.082992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=75,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:01.089969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:01.091779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:01.091779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:01.091779 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:01.092093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:01.092326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:01.144881 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:01.145479 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:01.153969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:01.154460 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:01.154949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:01.155655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:01.156110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:01.156563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:01.235253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:01.244933 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fb447811-e53f-422d-b45a-9bdecdd7c17f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1199 microversion: 2.1 time: 0.104939 Sep 07 14:55:01.245672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 547/1119] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:01 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1199 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:01.277916 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:01.286958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3a33e3b2-e95b-4c07-94a8-4f14e6b1c5b3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1593 microversion: 2.1 time: 0.210927 Sep 07 14:55:01.287674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 573/1120] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:01 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1593 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:02.269413 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:02.270624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:02.277967 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:02.278681 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:02.279630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:02.280377 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:02.281138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:02.281730 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:02.516369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:02.518309 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-beef83fa-2baa-4d2c-ad70-338d129b41f8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1277 microversion: 2.1 time: 0.252988 Sep 07 14:55:02.553266 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 548/1121] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:02 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1277 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:03.209184 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a650fba-0cdf-4cf3-acea-64cc1ba17eb6", "tag": "ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:03.226105 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:03.233420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:03.233420 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:03.241376 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] Creating event network-changed:ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df for instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 on hv-cinder-80135 Sep 07 14:55:03.246567 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-349351d2-9d9a-4e5c-8a25-548fd6cdabfd req-8dc77621-8c95-4d3c-9fd7-27c40a557fb4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040842 Sep 07 14:55:03.247246 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 574/1122] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:03.544186 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:03.545374 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:03.553384 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:03.556132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:03.556132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:03.557156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:03.557695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:03.558225 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:03.812542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:03.819101 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-bc1340b0-abe9-4918-a52f-db3401a1085c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.278816 Sep 07 14:55:03.819992 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 549/1123] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:03 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:04.078069 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:04.090608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:04.094242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:04.094935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:04.111711 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] Creating event network-changed:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:55:04.113498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-45c5f59d-cb86-4009-824d-74d66cc5c44e req-56ee2be6-8060-4903-9f9b-0e05eda79f78 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040472 Sep 07 14:55:04.114245 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 575/1124] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:04.844010 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:04.844673 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:04.857565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:04.863033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:04.863033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:04.863033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:04.863033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:04.863676 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:05.042987 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:05.051132 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-026e71b4-723f-47cd-8714-88e2de1ee10d tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.211999 Sep 07 14:55:05.052367 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 550/1125] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:04 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:06.074891 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:06.075577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:06.082090 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:06.082752 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:06.082999 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:06.083677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:06.084121 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:06.084559 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:06.218506 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:06.226357 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3c94fc7f-cd31-49a0-ad2d-bf8a532102a0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.155767 Sep 07 14:55:06.227579 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 576/1126] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:06 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:06.967179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1599650327"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:06.967744 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:06.974021 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:06.974514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:06.974953 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:06.975657 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:06.976112 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:06.976571 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.109574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.network.security_group_api [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Adding security group cae4ed50-7967-4243-a1d0-f762a1dfc46a to port 52bb172b-ccbd-4829-aa3b-c9ceb386155d Sep 07 14:55:07.249990 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:07.250614 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:07.253278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=30 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:07.258776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:07.259260 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:07.259693 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.260421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:07.260881 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:07.261296 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.481842 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:07.489956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-195e0209-881c-4271-a053-537a5f07690b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.244080 Sep 07 14:55:07.490526 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 577/1127] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:07 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:07.575618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-90c3ce62-c0e3-47ef-b72c-c0ce79e4b296 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action" status: 202 len: 0 microversion: 2.1 time: 0.612473 Sep 07 14:55:07.576661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 551/1128] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:55:06 2022] POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action => generated 0 bytes in 614 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:55:07.585998 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:07.586946 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:07.587064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:07.593378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:07.594215 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:07.594995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.595943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:07.596658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:07.597387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.600500 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:07.601226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:07.602488 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:07.622274 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] Creating event network-changed:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:55:07.629410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-9df650ce-1e3b-4e5d-b398-dff1d9e4c382 req-14eba747-a553-4455-841f-7e861addcc3f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046783 Sep 07 14:55:07.630655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 552/1129] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:07.775188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:07.786618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-0cd3c6c5-85b5-4155-9838-ebd3a6789b82 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1759 microversion: 2.1 time: 0.204492 Sep 07 14:55:07.787343 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 578/1130] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:07 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1759 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:08.515000 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:08.515717 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:08.518144 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:08.518825 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=6 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:08.523946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:08.527925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:08.527925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:08.527925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:08.527925 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:08.528358 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:08.663368 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:08.671388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-304b4b05-ee9e-4f7f-8638-0cf2a03fc281 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.160593 Sep 07 14:55:08.671949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 553/1131] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:08 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:09.695188 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:09.696171 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:09.698278 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:09.703185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:09.703676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:09.704113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:09.704848 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:09.705304 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:09.705730 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:09.838372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:09.846078 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e5fa963f-35bc-4b04-84f9-d3f447ec5c86 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.154896 Sep 07 14:55:09.846639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 579/1132] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:09 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:10.869542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:10.870108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:10.876924 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:10.877453 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:10.878036 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:10.878732 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:10.879191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:10.879619 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:11.012853 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:11.020388 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6645eaf3-15a2-4139-b55a-a9436ee1d038 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.155527 Sep 07 14:55:11.020943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 554/1133] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:10 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:12.043202 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:12.043817 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:12.050351 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:12.050834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:12.051272 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:12.051960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:12.052439 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:12.052864 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:12.179060 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:12.187331 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-b0564c5f-6686-47ea-8407-fc8878e45149 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.148179 Sep 07 14:55:12.187889 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 580/1134] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:12 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:13.210721 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:13.211903 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:13.218400 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:13.218883 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:13.219398 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:13.220090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:13.220590 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:13.221020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:13.355464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:13.363380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fb441a3c-a17a-419a-b5d9-9c026c08a022 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.156708 Sep 07 14:55:13.363948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 555/1135] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:13 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:14.386024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:14.386640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:14.393155 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:14.393639 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:14.394074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:14.394764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:14.395218 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:14.395643 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:14.525214 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:14.532832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-776b8bb8-b4f5-48ca-bd73-5d120ac48e15 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.150660 Sep 07 14:55:14.533391 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 581/1136] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:14 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:15.090628 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a650fba-0cdf-4cf3-acea-64cc1ba17eb6", "name": "network-vif-plugged", "status": "completed", "tag": "ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:15.100617 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:15.103214 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:15.103214 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:15.112799 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] Creating event network-vif-plugged:ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df for instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 on hv-cinder-80135 Sep 07 14:55:15.118972 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-0dd0d6e1-87bc-47d4-bab1-b23c0139536f req-029a0349-0271-4b23-9396-119f4f404525 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032478 Sep 07 14:55:15.119498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 556/1137] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:15.556642 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:15.557262 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:15.563634 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:15.564117 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:15.564590 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:15.565291 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:15.565751 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:15.566200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:15.698003 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:15.705660 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-82ff6dab-f54b-4594-b040-3c93a3f48b99 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.153623 Sep 07 14:55:15.706244 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 582/1138] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:15 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:16.729514 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:16.732452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:16.737063 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:16.737700 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:16.738173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:16.738865 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:16.739323 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:16.739777 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:16.875976 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:16.884246 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b3d112dd-8ff2-4cd3-8c88-672377f8bda1 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1265 microversion: 2.1 time: 0.158967 Sep 07 14:55:16.884768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 557/1139] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:16 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:17.909866 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:17.910467 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:17.916920 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:17.917401 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:17.917824 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:17.918501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:17.918948 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:17.919358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:18.050902 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:18.058577 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-d8e0ee50-9cc2-4ae7-a30c-d59cbaf06da8 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1452 microversion: 2.1 time: 0.152603 Sep 07 14:55:18.059240 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 583/1140] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:17 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:18.081287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:18.081929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:18.088986 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:18.089474 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:18.089909 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:18.090597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:18.091052 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:18.091477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:18.230123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:18.238496 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2c6acb07-e5a5-4717-a216-5e702462191a tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1452 microversion: 2.1 time: 0.161131 Sep 07 14:55:18.239065 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 558/1141] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:18 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1452 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:18.937233 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:18.939352 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:18.946569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:18.947050 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:18.947479 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:18.948191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:18.948646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:18.949062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:18.989834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-87ffcb04-0fd4-4268-925b-d2fd4e966af5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056520 Sep 07 14:55:18.990399 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 584/1142] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:55:18 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:55:19.055954 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:19.056476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:19.062748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:19.063228 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:19.063658 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:19.064378 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:19.064847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:19.065301 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:19.092295 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:55:19.369562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-87fdb7cb-5594-4560-b1ed-b318eb67f860 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 204 len: 0 microversion: 2.1 time: 0.318021 Sep 07 14:55:19.370352 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 559/1143] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:55:19 2022] DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:55:19.378562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:19.379180 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:19.385838 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:19.386649 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:19.387089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:19.390740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:19.390740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:19.390740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:19.642292 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:19.650667 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7e5d550f-626e-4eee-9471-79ee1d13ddf9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1673 microversion: 2.1 time: 0.275947 Sep 07 14:55:19.651236 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 585/1144] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:19 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1673 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:20.494834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a650fba-0cdf-4cf3-acea-64cc1ba17eb6", "tag": "ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:20.504606 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:20.505074 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:20.505504 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:20.517296 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] Creating event network-changed:ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df for instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 on hv-cinder-80135 Sep 07 14:55:20.522173 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-0ffc0dc3-0a83-48aa-91e8-95dec1471046 req-4933fa2a-7f98-4834-8eff-9fc0c1ef34df service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031841 Sep 07 14:55:20.523190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 560/1145] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:20.674463 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:20.675082 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:20.682471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:20.682956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:20.683388 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:20.684088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:20.684574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:20.684988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:20.820281 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:20.828185 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-37df4065-a092-4f12-85e9-18f7e837b705 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1673 microversion: 2.1 time: 0.157554 Sep 07 14:55:20.828759 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 586/1146] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:20 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1673 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:21.764029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:21.766446 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:21.772960 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:21.774067 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:21.774506 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:21.775200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:21.775653 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:21.776075 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:21.853358 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:21.854077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:21.860767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:21.861253 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:21.861687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:21.862437 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:21.862893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:21.863319 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:21.902364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:22.015151 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-886aed1d-c85f-47c0-bb7a-bece4d1743df tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action" status: 202 len: 0 microversion: 2.1 time: 0.255656 Sep 07 14:55:22.019430 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 561/1147] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:55:21 2022] POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action => generated 0 bytes in 259 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:55:22.034580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:22.035298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:22.041569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:22.042060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:22.042530 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:22.043711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:22.043711 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:22.044092 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:22.078433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:22.086354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f3f897fd-1fa3-4980-a0b0-a8debeecdc64 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1673 microversion: 2.1 time: 0.236816 Sep 07 14:55:22.086930 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 587/1148] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:21 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1673 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:22.246685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:22.255085 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d4cd19c2-bfbd-4fdc-84c1-471ee3d9f158 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1751 microversion: 2.1 time: 0.224857 Sep 07 14:55:22.257147 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 562/1149] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:22 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1751 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:22.596952 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4568f808-8f55-4c2a-8f9e-9b0d1ec93a23", "name": "network-vif-deleted", "tag": "7c410199-eb0f-4d91-b1be-d6b7ba21ad22"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:22.607315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:22.607767 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:22.608220 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:22.620264 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] Creating event network-vif-deleted:7c410199-eb0f-4d91-b1be-d6b7ba21ad22 for instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 on hv-cinder-80135 Sep 07 14:55:22.625530 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-de6add06-c0d8-4d0b-a4d2-7672a6488ccf req-640ac6ea-dc38-4a5e-b688-7c6182853c09 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032319 Sep 07 14:55:22.626455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 588/1150] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:55:23.109450 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:23.110078 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:23.116493 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:23.117070 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:23.117516 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:23.118224 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:23.118715 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:23.119147 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:23.154638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:23.155203 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:23.155725 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:23.156281 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lazy-loading 'fault' on Instance uuid 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:55:23.211798 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:23.219473 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-86fd6b99-846a-44ac-a7e4-cc98b72f1730 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 200 len: 1327 microversion: 2.1 time: 0.113975 Sep 07 14:55:23.220260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 563/1151] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:23 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 1327 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:23.280481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:23.281187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:23.288436 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:23.288955 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:23.289389 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:23.290087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:23.290537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:23.290956 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:23.444647 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:23.453731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c17e2736-0840-4dce-8412-0a7d392641b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.177330 Sep 07 14:55:23.454303 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 589/1152] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:23 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:24.243534 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:24.244624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:24.254532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:24.255017 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:24.255458 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:24.256162 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:24.256630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:24.257063 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:24.270140 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 HTTP/1.1 Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:55:24.271770 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:55:24.274849 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '4568f808-8f55-4c2a-8f9e-9b0d1ec93a23'} Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:55:24.275840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:55:24.277459 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:55:24.279124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:55:24.279124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-b699e0b1-52c3-4b46-aaca-4d176971b2b9 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 404 len: 111 microversion: 2.1 time: 0.035348 Sep 07 14:55:24.279124 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 564/1153] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:24 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:55:24.282770 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-30930969-fa44-4d29-9a5d-166a70711329 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '.version_select at 0x7fefdfd56e50>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:24.357406 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-30930969-fa44-4d29-9a5d-166a70711329 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961214077" status: 202 len: 0 microversion: 2.1 time: 0.078310 Sep 07 14:55:24.357969 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 590/1154] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:55:24 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1961214077 => generated 0 bytes in 79 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:55:24.477910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:24.478565 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:24.484686 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:24.485177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:24.485641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:24.486337 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:24.486789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:24.487262 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:24.654434 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:24.657396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-aa80cef7-e4a8-4d64-acfc-bb46e6bdd3a7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.183829 Sep 07 14:55:24.657946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 565/1155] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:24 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:25.117223 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c5961fca-d33f-4863-9cbd-e9d87820ef7c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: .version_select at 0x7fefdf74c550>, body: {"keypair": {"name": "tempest-keypair-1996500218", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBC6/0LXz6ryQwQCWaftrc6k+ldTGCHeKtNLm4B8ygBRqJqnuu+uKqyfE5iv7f+MhB8rwzkHWUEyqPqMnn9VURpY4zaSRaKer5hK+0X0yR/4X2RN03RDnvt9bs2a/LV4xhQ=="}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:25.133844 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-c5961fca-d33f-4863-9cbd-e9d87820ef7c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for project 375694ab50a34237bf53010138421f1b. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:55:25.137653 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.quota [None req-c5961fca-d33f-4863-9cbd-e9d87820ef7c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for user 6e21a071d561423689653593b30cdaed and project 375694ab50a34237bf53010138421f1b. Resources: {'key_pairs'} {{(pid=127536) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:55:25.201274 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c5961fca-d33f-4863-9cbd-e9d87820ef7c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.088447 Sep 07 14:55:25.201893 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 591/1156] 10.222.0.57 () {60 vars in 1159 bytes} [Wed Sep 7 14:55:25 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:25.681310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:25.681932 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:25.688462 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:25.688912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:25.689346 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:25.690050 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:25.690581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:25.691013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:25.840090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:25.848623 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-f575e70c-0485-4c9c-9fdc-673f388413e6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.171135 Sep 07 14:55:25.849188 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 566/1157] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:25 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:26.873688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:26.874301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:26.881023 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:26.881502 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:26.881934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:26.882646 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:26.883164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:26.883585 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:27.120062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:27.128258 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a1dbc4e8-d150-4408-ab04-460d7e952946 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.258440 Sep 07 14:55:27.128822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 592/1158] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:26 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:27.530988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1116287944", "imageRef": "a0c5c03a-a1a5-4c36-b932-a9559a9b251a", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "061d2f3b-e283-46de-a112-7b320d82db52"}], "security_groups": [{"name": "tempest-securitygroup--450707966"}], "key_name": "tempest-keypair-1996500218", "user_data": "}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:27.631860 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.network.neutron [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] validate_networks() for [('061d2f3b-e283-46de-a112-7b320d82db52', None, None, None, None, None)] {{(pid=127537) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 07 14:55:27.995135 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Flavor limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 07 14:55:27.995563 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Image limits 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 07 14:55:27.996071 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Flavor pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 07 14:55:27.996512 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Image pref 0:0:0 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 07 14:55:27.996929 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.virt.hardware [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=127537) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 07 14:55:27.999013 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:28.006415 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:28.006894 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:28.007943 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:28.008733 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:28.009185 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:28.009615 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:28.027217 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for project 375694ab50a34237bf53010138421f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 07 14:55:28.031143 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.quota [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Getting quotas for user 6e21a071d561423689653593b30cdaed and project 375694ab50a34237bf53010138421f1b. Resources: {'cores', 'ram', 'instances'} {{(pid=127537) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 07 14:55:28.042483 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Going to run 1 instances... {{(pid=127537) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 07 14:55:28.044793 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='a0c5c03a-a1a5-4c36-b932-a9559a9b251a',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=127537) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 07 14:55:28.151024 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:28.151732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:28.158167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:28.158640 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:28.159063 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:28.159742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:28.160211 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:28.160628 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:28.167773 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-675ce296-8bf2-4855-a6f5-d00eff0dada3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.641086 Sep 07 14:55:28.168513 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 567/1159] 10.222.0.57 () {60 vars in 1147 bytes} [Wed Sep 7 14:55:27 2022] POST /compute/v2.1/servers => generated 401 bytes in 642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 07 14:55:28.180200 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5f9f8953-21d7-407a-8c95-337984784bde tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:28.181421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=100 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:28.181554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5f9f8953-21d7-407a-8c95-337984784bde tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:28.259454 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5f9f8953-21d7-407a-8c95-337984784bde tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:28.267528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5f9f8953-21d7-407a-8c95-337984784bde tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1238 microversion: 2.1 time: 0.091673 Sep 07 14:55:28.268314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 568/1160] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:28 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1238 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:28.331267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:28.340133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-3192f118-65e3-4e3f-95e1-c70c775060f7 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.193237 Sep 07 14:55:28.340717 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 593/1161] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:28 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:29.290292 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:29.290927 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:29.298403 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:29.298884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:29.299317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:29.300005 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:29.300490 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:29.300916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:29.364012 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:29.364683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:29.367991 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:29.372062 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:29.372664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:29.373341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:29.374115 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:29.374635 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:29.375271 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:29.375908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-53b53841-4420-460b-ac02-5e780c6debdc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1234 microversion: 2.1 time: 0.089499 Sep 07 14:55:29.376756 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 569/1162] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:29 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:29.521251 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:29.530113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36261c37-3809-4a5c-a088-c1176eff5491 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.171183 Sep 07 14:55:29.530689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 594/1163] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:29 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:30.399882 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:30.400528 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:30.407153 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:30.407641 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:30.408463 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:30.408874 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:30.409336 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:30.409768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:30.473573 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:30.481895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-4dc2018b-1e07-4b61-a08f-be7abdabaa84 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1308 microversion: 2.1 time: 0.086875 Sep 07 14:55:30.482464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 570/1164] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:30 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1308 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:30.553125 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:30.553742 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:30.560615 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:30.561101 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:30.561537 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:30.562235 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:30.562688 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:30.563113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:30.711055 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:30.719327 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9dea0132-a7e5-4c06-8e28-e6f412dfe2ec tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.170078 Sep 07 14:55:30.719897 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 595/1165] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:30 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:31.505042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:31.505675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:31.512948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:31.513437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:31.513878 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:31.514585 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:31.515045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:31.515477 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:31.646110 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:31.654531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-2b1ab21f-f690-4aa5-910c-58ae5385a5f8 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.153330 Sep 07 14:55:31.655094 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 571/1166] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:31 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:31.743234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:31.743861 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:31.750419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:31.750910 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:31.751346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:31.752049 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:31.752578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:31.753008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:31.830059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3d8e8f-f57f-4c54-822c-20554f0cfbe9", "tag": "5e614ecd-799c-4d5e-93a1-4e701737804b"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:31.848978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:31.850661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:31.850661 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:31.862120 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] Creating event network-changed:5e614ecd-799c-4d5e-93a1-4e701737804b for instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 on hv-cinder-80135 Sep 07 14:55:31.868091 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-49735e1a-b293-426f-8411-347164fb3661 req-052160cd-7c43-45bb-80e1-cb181c211030 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042216 Sep 07 14:55:31.869125 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 572/1167] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:55:31.908919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:31.917346 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-60da5c8d-06b7-46ff-b206-288cca6f0ace tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.178434 Sep 07 14:55:31.918088 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 596/1168] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:31 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:32.683918 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:32.684649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:32.690660 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:32.691139 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:32.691578 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:32.692298 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:32.692752 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:32.693176 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:32.824338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:32.832016 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-22d923d5-bd36-4ec0-b55c-0e00b5517a15 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.152810 Sep 07 14:55:32.837192 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 573/1169] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:32 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:32.941337 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:32.942449 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:32.951316 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:32.951995 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:32.952458 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:32.953163 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:32.953609 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:32.954026 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:33.094553 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:33.102804 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-02fd2023-25ce-40e5-afe2-f75891a72486 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.166306 Sep 07 14:55:33.103377 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 597/1170] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:32 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:33.855452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:33.856042 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:33.862590 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:33.863080 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:33.863524 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:33.864240 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:33.864704 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:33.865134 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:34.004719 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:34.012624 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-349c3ca5-5295-46c8-8adc-70c1e0ad4593 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.161528 Sep 07 14:55:34.013183 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 574/1171] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:33 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:34.126674 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:34.127310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:34.133595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:34.134070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:34.134501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:34.135191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:34.135644 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:34.136066 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:34.275569 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:34.283925 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-62788137-e2aa-46a1-a392-766a19a968a0 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1756 microversion: 2.1 time: 0.161143 Sep 07 14:55:34.284583 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 598/1172] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:34 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1756 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:35.037759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:35.038443 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:35.045019 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.048287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.048287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.048287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.048287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.048706 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.287838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:35.297672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6625753b-3282-4dc1-a210-028cf5f601dc tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.264353 Sep 07 14:55:35.298227 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 575/1173] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:35 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:35.317695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:35.318412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:35.321541 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell0:SELECT=4 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:35.326697 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.327267 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.327765 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.328564 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.329097 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.329591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.775833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:35.784713 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4ab36893-ceb7-4d22-896c-1eef20f4eef3 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1759 microversion: 2.1 time: 0.471026 Sep 07 14:55:35.785294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 599/1174] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:35 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1759 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:35.941812 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:35.942317 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:35.953336 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:35.959656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.960195 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.960625 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.961335 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.961797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.962226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.963924 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:35.964461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:35.965092 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:35.981077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] Creating event network-changed:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:55:35.986441 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-64312c96-fbdc-4164-8d83-e75cd1791abe req-a5babc6c-e817-4b80-8c0a-28fee33a449c service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036642 Sep 07 14:55:35.987144 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 600/1175] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:35.999855 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:55:36.322760 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:36.323597 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:36.329346 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-09272c3f-0b1a-48c5-b10b-f9415d28d26c tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "DELETE /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 204 len: 0 microversion: 2.1 time: 0.391117 Sep 07 14:55:36.331178 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:36.332613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:36.343489 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 576/1176] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:55:35 2022] DELETE /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 0 bytes in 395 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:55:36.343669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:36.343669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:36.343669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:36.343669 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:36.343989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:36.343989 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:36.351097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:36.351597 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:36.352038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:36.352979 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:36.353515 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:36.354026 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:36.553390 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:36.562339 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-dc72fcb7-372f-4311-b12e-86a35b4fcb86 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.244441 Sep 07 14:55:36.563126 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 601/1177] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:36 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:36.564171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:36.572757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-fd6a4523-60e4-4f7a-90af-d543460c9935 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1567 microversion: 2.1 time: 0.235082 Sep 07 14:55:36.573333 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 577/1178] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:36 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1567 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:37.235310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3d8e8f-f57f-4c54-822c-20554f0cfbe9", "name": "network-vif-plugged", "status": "completed", "tag": "5e614ecd-799c-4d5e-93a1-4e701737804b"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:37.245719 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:37.246186 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:37.246608 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:37.261570 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] Creating event network-vif-plugged:5e614ecd-799c-4d5e-93a1-4e701737804b for instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 on hv-cinder-80135 Sep 07 14:55:37.268341 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-5d3ed3a0-00c6-4eb1-b439-0839929a3187 req-1e1c2b11-e523-4021-80a5-d9201815e6b8 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038505 Sep 07 14:55:37.268996 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 602/1179] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:37.588138 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:37.588826 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:37.595191 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:37.595671 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:37.596103 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:37.596818 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:37.597359 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:37.597784 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:37.597884 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:37.598074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:37.600666 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:37.606471 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:37.608070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:37.608070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:37.608387 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:37.608851 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:37.609280 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:37.804703 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:37.809492 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:37.812832 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5b57eaaf-1f4d-41fa-81ec-2883ab848943 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.228638 Sep 07 14:55:37.813405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 578/1180] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:37 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:37.818225 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-fd098fcc-cad9-4868-a7d3-6d4b8cf1b45d tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1448 microversion: 2.1 time: 0.225676 Sep 07 14:55:37.818788 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 603/1181] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:37 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1448 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:38.776285 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2281b075-fc96-43fb-b309-ad45a0c42bac", "name": "network-vif-deleted", "tag": "98e638e1-c9ce-4e4a-802b-25ae686c8421"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:38.781425 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:38.782264 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell0:SELECT=8 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:38.788032 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:38.789041 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:38.789476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:38.801540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] Creating event network-vif-deleted:98e638e1-c9ce-4e4a-802b-25ae686c8421 for instance 2281b075-fc96-43fb-b309-ad45a0c42bac on hv-cinder-80135 Sep 07 14:55:38.807179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-6456c007-098b-48a6-9899-35f17d671c09 req-745c7f3c-9860-4171-bee8-b8cdfb88afb4 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035191 Sep 07 14:55:38.807759 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 579/1182] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:38.837169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:38.838019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:38.841683 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:38.846033 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:38.846306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:38.846306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:38.846306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:38.846306 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:38.846689 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:38.847092 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:38.848768 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:38.849260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:38.849699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:38.850396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:38.851338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:38.851840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:38.856159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:55:38.945177 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:38.953965 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8b41ebdc-b193-4817-a3ff-ebb60d4f839a tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1381 microversion: 2.1 time: 0.116284 Sep 07 14:55:38.955478 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 580/1183] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:38 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1381 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:39.012127 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:39.020072 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36e8546e-0ce2-4b6b-977a-8aab7553acd3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1363 microversion: 2.1 time: 0.187007 Sep 07 14:55:39.020676 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 604/1184] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:38 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1363 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:39.980945 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:39.981612 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:39.989223 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:39.989816 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:39.990251 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:39.990997 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:39.991983 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:39.992436 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.024581 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:40.025106 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:40.025540 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.025984 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lazy-loading 'fault' on Instance uuid 2281b075-fc96-43fb-b309-ad45a0c42bac {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:55:40.043658 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:40.044299 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:40.051915 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:40.059581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:40.059581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.059581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:40.059581 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:40.059922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.071023 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2d34e301934743d5a457ae7fd979a53f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6bc6eee4ac194763a27bb87522d47c6c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:40.078696 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-1abde0f9-cac3-41c4-b908-11b15a8f59b1 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 200 len: 1224 microversion: 2.1 time: 0.102291 Sep 07 14:55:40.079254 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 581/1185] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:39 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 1224 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:55:40.190958 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:55:40.199499 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ca15240a-1e11-48a7-8ec2-d1c1e980f7ea tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1549 microversion: 2.1 time: 0.160198 Sep 07 14:55:40.200071 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 605/1186] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:40 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1549 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:55:40.221728 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:40.222158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:40.228999 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:40.229476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:40.229949 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.230639 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:40.231090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:40.231532 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:40.312474 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8809b5ed-6272-49a3-842e-abc22a6099b3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.094646 Sep 07 14:55:40.313193 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 582/1187] 10.222.0.57 () {58 vars in 1275 bytes} [Wed Sep 7 14:55:40 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:41.104102 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:41.104880 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] [instance: 2281b075-fc96-43fb-b309-ad45a0c42bac] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:55:41.111457 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:41.111942 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:41.112409 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:41.113107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:41.113562 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:41.113983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:41.127421 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] HTTP exception thrown: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Request method failure captured: Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac HTTP/1.1 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK-6BmOOE1N0NSoGY5oaNfHfxtTIvfbMDH6_8AGRKzacXcbQtR5O-7DrMPaeXaw_OBhNmyrN0FmZggXI_CArby3WQ9WxhM5jiK-MKhhFfQLK9Bj-vMDw0zlLoHhzYU6tskUg36YmqCpCbIX14Qo6oSV05jxZl6zcRCvZC98xFpmF3j0 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 6bc6eee4ac194763a27bb87522d47c6c Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestShelveInstance-1238708327 Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:55:41.129109 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_6bc6eee4ac194763a27bb87522d47c6c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bc6eee4ac194763a27bb87522d47c6c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/6bc6eee4ac194763a27bb87522d47c6c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/6bc6eee4ac194763a27bb87522d47c6c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestShelveInstance-1238708327 Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 6bc6eee4ac194763a27bb87522d47c6c Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestShelveInstance-1238708327 Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestShelveInstance-1238708327-project Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2d34e301934743d5a457ae7fd979a53f Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestShelveInstance-1238708327-project Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. Sep 07 14:55:41.131681 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '2281b075-fc96-43fb-b309-ad45a0c42bac'} Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:55:41.133089 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. Sep 07 14:55:41.134404 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:55:41.135619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Returning 404 to user: Instance 2281b075-fc96-43fb-b309-ad45a0c42bac could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:55:41.135619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e326464a-9981-494e-86f0-2e2cf0c54478 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac" status: 404 len: 111 microversion: 2.1 time: 0.030339 Sep 07 14:55:41.135619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 606/1188] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:55:41 2022] GET /compute/v2.1/servers/2281b075-fc96-43fb-b309-ad45a0c42bac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:55:41.364097 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9d3d8e8f-f57f-4c54-822c-20554f0cfbe9", "tag": "5e614ecd-799c-4d5e-93a1-4e701737804b"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:55:41.376542 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:55:41.377086 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:55:41.377533 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:55:41.378828 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-bb6667ba-88d1-4aef-a4de-2f52d44aca97 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] Calling method '.version_select at 0x7fefdfac9160>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:55:41.393739 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] Creating event network-changed:5e614ecd-799c-4d5e-93a1-4e701737804b for instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 on hv-cinder-80135 Sep 07 14:55:41.405064 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-f51fda3b-90b2-40a3-9686-6d31204b20c0 req-78ba1142-a843-4403-9a44-0b898eeedc5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044489 Sep 07 14:55:41.405675 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 583/1189] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:55:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:55:41.470482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-bb6667ba-88d1-4aef-a4de-2f52d44aca97 tempest-TestShelveInstance-1238708327 tempest-TestShelveInstance-1238708327-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1633278026" status: 202 len: 0 microversion: 2.1 time: 0.095610 Sep 07 14:55:41.471320 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 607/1190] 10.222.0.57 () {58 vars in 1254 bytes} [Wed Sep 7 14:55:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1633278026 => generated 0 bytes in 97 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 07 14:56:14.353161 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:14.353920 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=18 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:14.354656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:56:14.354789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Wed Sep 7 14:56:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action (ip 10.222.0.57) !!! Sep 07 14:56:14.359920 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1599650327"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:14.360498 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:14.368083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:14.376736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:14.376736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:14.376736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:14.376736 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:14.377213 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:14.699695 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.network.security_group_api [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Removing security group cae4ed50-7967-4243-a1d0-f762a1dfc46a from port 52bb172b-ccbd-4829-aa3b-c9ceb386155d Sep 07 14:56:15.083381 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-7e37e151-5b0d-489f-8c02-2f65e75c63b6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action" status: 202 len: 0 microversion: 2.1 time: 0.731939 Sep 07 14:56:15.087898 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 584/1191] 10.222.0.57 () {60 vars in 1278 bytes} [Wed Sep 7 14:56:14 2022] POST /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/action => generated 0 bytes in 733 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:15.093345 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=68 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:15.093728 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=10,nova_api:DELETE=1 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:15.094899 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 07 14:56:15.095053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Wed Sep 7 14:56:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.57) !!! Sep 07 14:56:15.183599 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:15.195128 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:15.195849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:15.196479 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:15.209354 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] Creating event network-changed:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:56:15.216189 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-ed09232e-af9e-44c3-9683-1ad57ad4f4e3 req-5f615966-ec40-4230-8c0a-f078ce4b4482 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.125211 Sep 07 14:56:15.217380 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 608/1192] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 07 14:56:16.325148 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:16.325685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:16.332757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:16.333248 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:16.333692 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:16.334395 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:16.334847 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:16.335895 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:16.416108 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lazy-loading 'services' on Instance uuid b05177fa-88be-4cae-83ae-b4e005f17879 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:56:16.622260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-701f6e38-e92e-4616-a6fd-804ce74b1bd9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments/f85baab4-ff8d-47a6-b88d-bc1d38670ddb" status: 202 len: 0 microversion: 2.1 time: 0.302324 Sep 07 14:56:16.622985 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 585/1193] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:56:16 2022] DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments/f85baab4-ff8d-47a6-b88d-bc1d38670ddb => generated 0 bytes in 304 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:16.634315 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:16.636792 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:16.644107 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:16.644617 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:16.645053 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:16.645809 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:16.646204 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:16.646624 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:16.678440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-94b9bb2e-212c-445b-9b11-df006b508b7e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050729 Sep 07 14:56:16.679482 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 609/1194] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:16 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:17.236834 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:17.247390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.247872 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.248338 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.260899 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] Creating event network-changed:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:56:17.266165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-95dcc7fe-0c7a-4448-b571-150908e1df1a req-0ab95677-44cf-4c66-a1da-8e5c3dc34e5a service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036955 Sep 07 14:56:17.266775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 586/1195] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:17.460664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:17.461167 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:17.467687 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.468304 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.468746 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.469445 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.469898 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.470326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.495154 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4658954e-1185-45e1-986b-baf9088dca27 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/ips" status: 200 len: 146 microversion: 2.1 time: 0.038930 Sep 07 14:56:17.495743 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 610/1196] 10.222.0.57 () {58 vars in 1248 bytes} [Wed Sep 7 14:56:17 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/ips => generated 146 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:17.692045 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:17.694574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:17.701263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.701726 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.702158 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.702877 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.703329 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.703748 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.734165 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-0abd0ae1-ec3d-4ef0-849e-09e2e6d0f979 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046340 Sep 07 14:56:17.734630 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 587/1197] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:17 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:56:17.745851 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:17.747191 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:17.753753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.754298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.756834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.756834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:17.756834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:17.756834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:17.934117 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] HTTP exception thrown: Instance b05177fa-88be-4cae-83ae-b4e005f17879 is not attached to volume f85baab4-ff8d-47a6-b88d-bc1d38670ddb Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Request method failure captured: Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments/f85baab4-ff8d-47a6-b88d-bc1d38670ddb HTTP/1.1 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLCGvjJpB3bBteEKFinLmIm4yMPwY1u0DrgFPE9mL1nfm5XaxsBQY9JmS8jSL292C7jDGMbXLSnWab47F5csQ8MmpL7uIWw5zIM5reW2vUxr15LbRykNKsS4y8kwEHf7c2mJCmdC-SOLeFsZYbjh0CM3Ivu9DC5CqmmzY4XfYiFgiB4 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2710cdaf256342faae76fd5451ed432b Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:17.936481 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2710cdaf256342faae76fd5451ed432b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2710cdaf256342faae76fd5451ed432b Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestMinimumBasicScenario-563263738-project Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: c18dbeea047a4505b2d5417dc54e8cb4 Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestMinimumBasicScenario-563263738-project Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:17.938013 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance b05177fa-88be-4cae-83ae-b4e005f17879 is not attached to volume f85baab4-ff8d-47a6-b88d-bc1d38670ddb Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'server_id': 'b05177fa-88be-4cae-83ae-b4e005f17879', 'id': 'f85baab4-ff8d-47a6-b88d-bc1d38670ddb'} Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id f85baab4-ff8d-47a6-b88d-bc1d38670ddb. Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:17.939035 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05177fa-88be-4cae-83ae-b4e005f17879 is not attached to volume f85baab4-ff8d-47a6-b88d-bc1d38670ddb Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05177fa-88be-4cae-83ae-b4e005f17879 is not attached to volume f85baab4-ff8d-47a6-b88d-bc1d38670ddb Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:17.945670 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Returning 404 to user: Instance b05177fa-88be-4cae-83ae-b4e005f17879 is not attached to volume f85baab4-ff8d-47a6-b88d-bc1d38670ddb {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:17.947104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a5974164-3f38-42ef-8cb0-af01278dbab6 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments/f85baab4-ff8d-47a6-b88d-bc1d38670ddb" status: 404 len: 154 microversion: 2.1 time: 0.196479 Sep 07 14:56:17.947104 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 611/1198] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:56:17 2022] DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879/os-volume_attachments/f85baab4-ff8d-47a6-b88d-bc1d38670ddb => generated 154 bytes in 198 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:19.172789 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9368a55-6727-4543-9478-06756d515221"}} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:19.175122 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:19.181484 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.181971 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.182410 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.183104 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.183560 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.183988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.238868 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:19.239509 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:19.245854 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.246328 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.246753 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.247431 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.247879 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.248326 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.275939 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:56:19.645133 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-ba23ed9c-70e4-4b0b-807b-6f65d4af70dc tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 204 len: 0 microversion: 2.1 time: 0.409805 Sep 07 14:56:19.645715 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 612/1199] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:19 2022] DELETE /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 07 14:56:19.654574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:19.658938 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:19.661774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.662217 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.662654 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.663983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:19.664496 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:19.664928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:19.804510 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:19.812242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-f135278c-ea39-4b87-8b27-5165e230eff2 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1553 microversion: 2.1 time: 0.161726 Sep 07 14:56:19.819153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 613/1200] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:19 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1553 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:56:20.041115 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a2fc57d7-df4d-4f5d-ae59-f83a3f2e4fff tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.872066 Sep 07 14:56:20.041720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 588/1201] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:56:19 2022] POST /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:20.836683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:20.837325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:20.843748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:20.844263 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:20.844698 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:20.845383 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:20.845834 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:20.846255 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:20.979551 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:20.987234 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-080446ff-1bb6-4a69-a23c-3dfb66b88754 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1553 microversion: 2.1 time: 0.155035 Sep 07 14:56:20.987790 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 614/1202] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:20 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1553 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:22.010833 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:22.011446 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:22.017922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:22.018400 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:22.018832 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:22.019520 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:22.019973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:22.020427 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:22.074428 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b05177fa-88be-4cae-83ae-b4e005f17879", "name": "network-vif-deleted", "tag": "52bb172b-ccbd-4829-aa3b-c9ceb386155d"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:22.084423 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:22.084910 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:22.085376 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:22.088690 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c18dbeea047a4505b2d5417dc54e8cb4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2710cdaf256342faae76fd5451ed432b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:22.096473 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-357a7cb6-8bc0-4c8b-9545-55954a33794e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 200 len: 1511 microversion: 2.1 time: 0.089766 Sep 07 14:56:22.097142 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] Creating event network-vif-deleted:52bb172b-ccbd-4829-aa3b-c9ceb386155d for instance b05177fa-88be-4cae-83ae-b4e005f17879 on hv-cinder-80135 Sep 07 14:56:22.097425 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 615/1203] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:22 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 1511 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:22.102067 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-395ed745-4f23-4246-b5e1-bc606de552bd req-12fed0d6-79b6-429a-8cd1-89f1909914dc service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098570 Sep 07 14:56:22.102754 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 589/1204] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:23.119793 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:23.120578 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] [instance: b05177fa-88be-4cae-83ae-b4e005f17879] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:23.126924 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:23.127396 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:23.127822 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:23.128532 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:23.128978 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:23.129392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:23.146443 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] HTTP exception thrown: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Request method failure captured: Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 HTTP/1.1 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGLCGvjJpB3bBteEKFinLmIm4yMPwY1u0DrgFPE9mL1nfm5XaxsBQY9JmS8jSL292C7jDGMbXLSnWab47F5csQ8MmpL7uIWw5zIM5reW2vUxr15LbRykNKsS4y8kwEHf7c2mJCmdC-SOLeFsZYbjh0CM3Ivu9DC5CqmmzY4XfYiFgiB4 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 2710cdaf256342faae76fd5451ed432b Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:23.148059 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_2710cdaf256342faae76fd5451ed432b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/2710cdaf256342faae76fd5451ed432b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 2710cdaf256342faae76fd5451ed432b Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestMinimumBasicScenario-563263738 Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestMinimumBasicScenario-563263738-project Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: c18dbeea047a4505b2d5417dc54e8cb4 Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestMinimumBasicScenario-563263738-project Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. Sep 07 14:56:23.150129 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': 'b05177fa-88be-4cae-83ae-b4e005f17879'} Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:23.151265 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. Sep 07 14:56:23.155298 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:23.156774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Returning 404 to user: Instance b05177fa-88be-4cae-83ae-b4e005f17879 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:23.156774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-7d9832b4-bd90-407b-bfa7-d2f8e0469d0e tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879" status: 404 len: 111 microversion: 2.1 time: 0.034556 Sep 07 14:56:23.156774 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 616/1205] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:23 2022] GET /compute/v2.1/servers/b05177fa-88be-4cae-83ae-b4e005f17879 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:23.158963 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-53f04be7-8a94-4d46-89ec-bdbbfb1e58e9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] Calling method '.version_select at 0x7fefdfa1a310>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:23.255090 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-53f04be7-8a94-4d46-89ec-bdbbfb1e58e9 tempest-TestMinimumBasicScenario-563263738 tempest-TestMinimumBasicScenario-563263738-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-253911819" status: 202 len: 0 microversion: 2.1 time: 0.100194 Sep 07 14:56:23.255674 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 590/1206] 10.222.0.57 () {58 vars in 1269 bytes} [Wed Sep 7 14:56:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-253911819 => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:28.671015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:28.673261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:28.679739 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:28.680252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:28.680683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:28.681378 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:28.681826 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:28.682261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:28.711837 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-36b4c5e5-2f40-4627-8bfc-df822bfc69cb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044553 Sep 07 14:56:28.712356 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 617/1207] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:28 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:28.723083 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:28.723743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:28.731707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:28.732215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:28.732663 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:28.733365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:28.733823 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:28.734253 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:28.763221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d47c9d62-de79-4a5c-87a4-c61e90493060 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221" status: 200 len: 194 microversion: 2.1 time: 0.044139 Sep 07 14:56:28.763819 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 591/1208] 10.222.0.57 () {58 vars in 1413 bytes} [Wed Sep 7 14:56:28 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:30.452168 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "70d3e9ac-f03d-44ea-ac8f-17914d942098"}} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:30.454512 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:30.463014 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:30.465268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:30.465268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:30.465268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:30.465268 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:30.465744 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:31.135683 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e4b7378f-8f65-4c70-b04e-415339bda9a4 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "POST /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.687306 Sep 07 14:56:31.136533 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 618/1209] 10.222.0.57 () {60 vars in 1323 bytes} [Wed Sep 7 14:56:30 2022] POST /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 194 bytes in 689 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:38.711844 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:38.714062 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:38.720635 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.721119 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.721562 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:38.722258 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.722731 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.723156 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:38.753654 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e31498fc-20c7-4b0c-b6fe-c4f3557cc51f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.045830 Sep 07 14:56:38.754211 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 592/1210] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:38 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 371 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:38.897613 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:38.899030 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:38.905983 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.912539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.912539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:38.912539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.912539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.912973 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:38.939591 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-374f50bb-fd4b-4c52-9fd8-d938cb5cd39c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221" status: 200 len: 194 microversion: 2.1 time: 0.046201 Sep 07 14:56:38.940672 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 619/1211] 10.222.0.57 () {58 vars in 1413 bytes} [Wed Sep 7 14:56:38 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221 => generated 194 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:38.952027 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:38.952546 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:38.958424 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.959116 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.959790 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:38.961697 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:38.962452 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:38.963121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:39.054179 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lazy-loading 'services' on Instance uuid 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:56:39.287438 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-3a4fc19d-cd28-47af-acfd-639886abdf1f tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221" status: 202 len: 0 microversion: 2.1 time: 0.339445 Sep 07 14:56:39.288030 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 593/1212] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:56:38 2022] DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/d9368a55-6727-4543-9478-06756d515221 => generated 0 bytes in 341 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:41.465198 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:41.465696 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:41.472086 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:41.472598 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:41.473032 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:41.473718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:41.474169 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:41.474590 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:41.503286 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-42d518d0-475d-4645-9454-94a22961b9f7 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/70d3e9ac-f03d-44ea-ac8f-17914d942098" status: 200 len: 194 microversion: 2.1 time: 0.041938 Sep 07 14:56:41.503778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 620/1213] 10.222.0.57 () {58 vars in 1413 bytes} [Wed Sep 7 14:56:41 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/70d3e9ac-f03d-44ea-ac8f-17914d942098 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:41.515775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:41.516396 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:41.522485 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:41.523003 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:41.523439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:41.524418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:41.524870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:41.525293 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:41.605055 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lazy-loading 'services' on Instance uuid 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:56:41.790038 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e65a37e7-c7f6-4ba3-80b6-d1a40e1149e1 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/70d3e9ac-f03d-44ea-ac8f-17914d942098" status: 202 len: 0 microversion: 2.1 time: 0.278683 Sep 07 14:56:41.790584 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 594/1214] 10.222.0.57 () {58 vars in 1416 bytes} [Wed Sep 7 14:56:41 2022] DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments/70d3e9ac-f03d-44ea-ac8f-17914d942098 => generated 0 bytes in 280 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:42.965495 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:42.967797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:42.974454 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:42.974943 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:42.975407 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:42.976110 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:42.976655 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:42.977157 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.009556 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-894bc870-21ff-4aca-a390-f7e24f341218 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048099 Sep 07 14:56:43.010111 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 621/1215] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:42 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:56:43.126278 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:43.128580 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:43.135439 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.135928 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.136470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.141121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.141121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.141121 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.167020 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-60081be4-3044-477c-9fc9-09b3876257a5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045565 Sep 07 14:56:43.167569 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 595/1216] 10.222.0.57 () {58 vars in 1302 bytes} [Wed Sep 7 14:56:43 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 07 14:56:43.229885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:43.230385 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:43.236261 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.236748 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.237187 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.237875 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.238335 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.238757 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.263778 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:56:43.277849 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:43.596077 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-a85829d6-9c26-458f-adf2-848d8bd3b9e5 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 204 len: 0 microversion: 2.1 time: 0.370155 Sep 07 14:56:43.596727 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 622/1217] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:43 2022] DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 0 bytes in 372 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:56:43.611076 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:43.611716 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:43.617750 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.618226 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.618655 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.619331 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:43.619775 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:43.620219 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:43.750873 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:43.758685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-ebd405cd-7bda-4f59-8cc5-51f782d5f4bb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1674 microversion: 2.1 time: 0.151458 Sep 07 14:56:43.760215 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 596/1218] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:43 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:44.783294 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:44.783994 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:44.791019 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:44.791501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:44.791937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:44.792661 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:44.793116 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:44.793539 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:44.923522 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:44.932093 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e7a2e5ba-f462-42df-84fd-4200143d513c tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1674 microversion: 2.1 time: 0.153060 Sep 07 14:56:44.932677 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 623/1219] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:44 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1674 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:45.956043 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:45.956916 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:45.959435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_api:SELECT=28,nova_api:DELETE=1 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:45.964323 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:45.964820 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:45.969737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:45.969737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:45.969737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:45.969737 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:45.971287 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG dbcounter [-] [127537] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=4,nova_cell1:UPDATE=2 {{(pid=127537) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:46.033688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:46.041435 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6c6ca626-9fdf-436f-a397-144ecef66e97 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1607 microversion: 2.1 time: 0.089292 Sep 07 14:56:46.042001 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 597/1220] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:45 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1607 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:56:46.143618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9d3d8e8f-f57f-4c54-822c-20554f0cfbe9", "name": "network-vif-deleted", "tag": "5e614ecd-799c-4d5e-93a1-4e701737804b"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:46.154384 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:46.154863 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:46.155288 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:46.167189 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] Creating event network-vif-deleted:5e614ecd-799c-4d5e-93a1-4e701737804b for instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 on hv-cinder-80135 Sep 07 14:56:46.172229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-74df7765-c063-4201-8862-7be7bc2af9d4 req-e9fcc092-c982-4fb2-b132-c90bb8f84178 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032365 Sep 07 14:56:46.172818 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 624/1221] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:47.065766 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:47.066470 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:47.073586 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:47.074159 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:47.074663 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:47.075366 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:47.075815 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:47.076263 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:47.107797 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:47.108306 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:47.108743 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:47.109182 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lazy-loading 'fault' on Instance uuid 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:56:47.153305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e21a071d561423689653593b30cdaed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '375694ab50a34237bf53010138421f1b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:47.161389 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-509843e2-61d3-497c-81b7-007c53f29ccf tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 200 len: 1328 microversion: 2.1 time: 0.100123 Sep 07 14:56:47.162163 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 598/1222] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:47 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:48.185776 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:48.186501 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:48.188461 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG dbcounter [-] [127536] Writing DB stats nova_api:SELECT=45,nova_api:UPDATE=2 {{(pid=127536) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 07 14:56:48.193289 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:48.193815 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:48.194229 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:48.194922 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:48.195375 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:48.195799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:48.210392 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 HTTP/1.1 Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:48.212519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:48.214435 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9d3d8e8f-f57f-4c54-822c-20554f0cfbe9'} Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:48.215455 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:48.217238 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:48.218731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:48.218731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-29694285-611c-47bb-ac1b-517faf00ae60 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 404 len: 111 microversion: 2.1 time: 0.032806 Sep 07 14:56:48.218731 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 625/1223] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:48 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:48.222741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d47618ae-0a91-4baa-bf2e-acfa40f58b7b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '.version_select at 0x7fefdfa50dc0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:48.305842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d47618ae-0a91-4baa-bf2e-acfa40f58b7b tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996500218" status: 202 len: 0 microversion: 2.1 time: 0.086823 Sep 07 14:56:48.306437 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 599/1224] 10.222.0.57 () {58 vars in 1221 bytes} [Wed Sep 7 14:56:48 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1996500218 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 07 14:56:48.688618 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1a650fba-0cdf-4cf3-acea-64cc1ba17eb6", "tag": "ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:48.689626 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:48.690372 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:48.697664 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:48.698365 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:48.699008 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:48.699805 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:48.700500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:48.700992 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:48.702917 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:48.703614 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:48.704260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:48.717476 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] Creating event network-changed:ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df for instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 on hv-cinder-80135 Sep 07 14:56:48.724280 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-0d31531a-d358-4ef8-aca0-36e81f948ddd req-37e5a63e-b72c-4161-85eb-407432b7e81f service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043388 Sep 07 14:56:48.725918 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 600/1225] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:48.737242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Going to try to terminate instance {{(pid=127536) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:56:49.035857 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-9ef0ed27-2504-4e22-8d7e-1a43414b8dc5 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 204 len: 0 microversion: 2.1 time: 0.357763 Sep 07 14:56:49.036823 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 626/1226] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:48 2022] DELETE /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:56:49.046587 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:49.046969 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:49.055171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:49.055805 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:49.056364 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:49.057181 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:49.057720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:49.058221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:49.217249 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:49.226810 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-d5082ee6-29b8-4345-87f3-53d85bcdb7e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1577 microversion: 2.1 time: 0.184785 Sep 07 14:56:49.236418 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 601/1227] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:49 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1577 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:50.251419 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:50.252764 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:50.259150 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:50.259637 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:50.260074 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:50.260797 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:50.261252 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:50.261700 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:50.394476 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:50.403619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-da4cc6d2-6b45-4d63-acdf-470150361ee7 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1577 microversion: 2.1 time: 0.156120 Sep 07 14:56:50.403877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 627/1228] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:50 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1577 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 07 14:56:51.310405 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1a650fba-0cdf-4cf3-acea-64cc1ba17eb6", "name": "network-vif-deleted", "tag": "ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df"}]} {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:51.320300 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.320776 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.321212 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.333891 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.compute.server_external_events [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] Creating event network-vif-deleted:ce41ff0f-9a8a-4e3a-ac5e-06557f8bb2df for instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 on hv-cinder-80135 Sep 07 14:56:51.339141 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [req-f98b07af-1483-4c9f-9df7-d6deedfaed04 req-181faab9-81ee-41fe-8cff-442c5b6aa24b service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032440 Sep 07 14:56:51.339720 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 602/1229] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:51.426718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:51.427381 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:51.434242 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.434724 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.435310 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.436015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.436686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.437113 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.500108 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:51.507786 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-4c87284f-d807-411d-a0df-25f55b19ac50 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1390 microversion: 2.1 time: 0.084884 Sep 07 14:56:51.508397 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 628/1230] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:51 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1390 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:51.735346 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:51.735934 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:51.742707 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.743190 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.743649 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.744365 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.744842 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.745272 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.758539 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 HTTP/1.1 Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:56:51.760221 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.761908 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '9d3d8e8f-f57f-4c54-822c-20554f0cfbe9'} Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:51.763029 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.764672 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.766380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:51.766380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-8d685bb3-a72e-47de-bc3c-e18c893fe4c3 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 404 len: 111 microversion: 2.1 time: 0.030449 Sep 07 14:56:51.766380 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 603/1231] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:51 2022] DELETE /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:51.770244 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:51.770862 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:51.777118 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.777595 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.778027 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.778707 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:51.779156 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:51.779575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:51.795519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 HTTP/1.1 Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:51.797208 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.798932 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9d3d8e8f-f57f-4c54-822c-20554f0cfbe9'} Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:51.799951 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. Sep 07 14:56:51.801763 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:51.803325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:51.803325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-2c31acaa-3ba0-41d6-a878-5dac473e5032 tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9" status: 404 len: 111 microversion: 2.1 time: 0.032425 Sep 07 14:56:51.803325 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 629/1232] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:51 2022] GET /compute/v2.1/servers/9d3d8e8f-f57f-4c54-822c-20554f0cfbe9 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:52.530751 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:52.531369 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:52.537787 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:52.538260 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:52.541356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:52.541356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:52.541356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:52.541356 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:52.571794 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:52.572314 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:52.572757 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:52.573204 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.objects.instance [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lazy-loading 'fault' on Instance uuid 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 {{(pid=127537) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 07 14:56:52.617467 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:52.625390 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e8bf6d73-6598-4333-b0ef-9e748b20fe96 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 200 len: 1229 microversion: 2.1 time: 0.098556 Sep 07 14:56:52.627554 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 604/1233] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:52 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 1229 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:53.074285 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:53.074783 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:53.081106 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.081582 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.082015 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.082699 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.083148 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.083567 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.096723 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 HTTP/1.1 Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:53.098203 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.099935 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '4568f808-8f55-4c2a-8f9e-9b0d1ec93a23'} Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:53.100960 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.103087 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.104732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:53.104732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-e9c6aee6-9860-460a-9f03-352bf8bdcbec tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 404 len: 111 microversion: 2.1 time: 0.029144 Sep 07 14:56:53.104732 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 630/1234] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:53 2022] DELETE /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:53.109948 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:53.110610 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] [instance: 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:53.116501 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.117638 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.118077 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.118801 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.119259 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.119688 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.132814 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] HTTP exception thrown: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Request method failure captured: Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 HTTP/1.1 Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK_9D05csKeBomaVot-STby8DwVUWxW9sXOMpCtfkE8CeuDFHpjGJSZFwpRmwTdj4_4gpJFm3_3e2LuQPO_mUe_mXUpMuH2gIvS_Z3_0KWCkOQlzmf3ZQJJs75zoPWAvSMPy1Tlo8DeGTZioBeuxP44vzgZKpTE4tudenwzuYIZTOCk Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:56:53.134312 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_375694ab50a34237bf53010138421f1b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/375694ab50a34237bf53010138421f1b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/375694ab50a34237bf53010138421f1b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 375694ab50a34237bf53010138421f1b Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1966762709 Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 6e21a071d561423689653593b30cdaed Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-AttachVolumeTestJSON-1966762709-project Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.135978 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '4568f808-8f55-4c2a-8f9e-9b0d1ec93a23'} Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:53.137059 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. Sep 07 14:56:53.138370 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.139698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] Returning 404 to user: Instance 4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:53.139698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-5c0faf57-81a5-447f-9291-96289763b9eb tempest-AttachVolumeTestJSON-1966762709 tempest-AttachVolumeTestJSON-1966762709-project] 10.222.0.57 "GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23" status: 404 len: 111 microversion: 2.1 time: 0.029597 Sep 07 14:56:53.139698 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 605/1235] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:53 2022] GET /compute/v2.1/servers/4568f808-8f55-4c2a-8f9e-9b0d1ec93a23 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:53.649433 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:53.650045 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:53.655988 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.656500 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.656934 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.657619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:53.658070 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:53.658493 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:53.671749 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] HTTP exception thrown: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Request method failure captured: Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 HTTP/1.1 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK9-os36cXsg_5C5A6zmIS72vkF-tX8Do_EgFYP9Oj-b-JsuJBa_kpXaKDE-9ggAqV03ll-AaMXjKtTgPlIp8-Fws1H_JkV-vcfsZODUaqTx8JmdgKPWVh8IYCJbcnR1atA5K83N59jBorEau7VeX_jNTB3Cy7DQuCaDX3YyIjwd-6k Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:56:53.673771 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestVolumeBootPattern-741965744 Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2a6a637072b04667a3f21da9c57325c0 Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. Sep 07 14:56:53.675498 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '1a650fba-0cdf-4cf3-acea-64cc1ba17eb6'} Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:56:53.677137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. Sep 07 14:56:53.678618 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:56:53.680574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Returning 404 to user: Instance 1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:56:53.680574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-cdb82c6d-9ee8-47b3-8d10-1afae29d5c7c tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6" status: 404 len: 111 microversion: 2.1 time: 0.029418 Sep 07 14:56:53.680574 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 631/1236] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:53 2022] GET /compute/v2.1/servers/1a650fba-0cdf-4cf3-acea-64cc1ba17eb6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:56:57.152693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:57.152693 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:57.153314 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9431d0e2-c490-480a-ad68-6d1ea094bf1f", "tag": "e951d311-be74-4573-b4ad-1e6b298fdd52"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:57.159394 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:57.160325 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:57.160838 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:57.161936 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:57.162472 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:57.162974 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:57.163084 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:57.163596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:57.164575 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:57.182957 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] Creating event network-changed:e951d311-be74-4573-b4ad-1e6b298fdd52 for instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f on hv-cinder-80135 Sep 07 14:56:57.188170 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-2f32e14d-ca58-4fbd-b460-91329467f8f8 req-15d706ff-5527-404e-9f51-462135422be6 service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038796 Sep 07 14:56:57.189095 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 632/1237] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:57.195870 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Going to try to terminate instance {{(pid=127537) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 07 14:56:57.540305 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-eb075c9d-3622-4b84-aae3-531c4f85c1e0 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 204 len: 0 microversion: 2.1 time: 0.393841 Sep 07 14:56:57.541591 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 606/1238] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:56:57 2022] DELETE /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 07 14:56:57.550209 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:57.550919 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:57.557877 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:57.558364 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:57.559153 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:57.559928 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:57.560412 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:57.560843 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:57.736974 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.policy [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127536) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:57.746360 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-c6a8bfd8-89ab-487c-be7b-00fa1ef4488b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1577 microversion: 2.1 time: 0.200433 Sep 07 14:56:57.746937 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 633/1239] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:57 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1577 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:58.770269 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:58.770962 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:58.778265 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:58.778741 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:58.779171 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:58.779869 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:58.780343 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:58.780772 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:58.917836 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:56:58.925666 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-9b7f4824-67de-4b07-ba3a-656708f3622f tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1458 microversion: 2.1 time: 0.159688 Sep 07 14:56:58.926233 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 607/1240] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:58 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1458 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:56:59.602695 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9431d0e2-c490-480a-ad68-6d1ea094bf1f", "name": "network-vif-deleted", "tag": "e951d311-be74-4573-b4ad-1e6b298fdd52"}]} {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 07 14:56:59.612405 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:59.612876 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:59.613301 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:59.624740 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.compute.server_external_events [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] Creating event network-vif-deleted:e951d311-be74-4573-b4ad-1e6b298fdd52 for instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f on hv-cinder-80135 Sep 07 14:56:59.630694 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [req-98d20d39-bfcb-43b2-a3d7-81c1d253a31b req-62cb7726-b3c4-43ce-85df-80a9c9e6a4eb service nova] 10.222.0.57 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031604 Sep 07 14:56:59.631428 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 634/1241] 10.222.0.57 () {64 vars in 1317 bytes} [Wed Sep 7 14:56:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 07 14:56:59.950282 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:56:59.953559 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:56:59.959946 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:59.960520 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:59.960964 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:56:59.961685 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:56:59.962146 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:56:59.962574 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:00.042912 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.policy [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2a6a637072b04667a3f21da9c57325c0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5c7b26a4966c4c309d058d1d19d5d553', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=127537) authorize /opt/stack/nova/nova/policy.py:199}} Sep 07 14:57:00.051988 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-e3e56455-9684-4edf-8db4-8f953bc3e787 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 200 len: 1224 microversion: 2.1 time: 0.105581 Sep 07 14:57:00.052764 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 608/1242] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:56:59 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 1224 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 07 14:57:01.077612 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:57:01.078322 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9431d0e2-c490-480a-ad68-6d1ea094bf1f] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:57:01.084515 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.085001 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.085440 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.086137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.086596 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.087021 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.100295 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] HTTP exception thrown: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Request method failure captured: Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f HTTP/1.1 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK9-os36cXsg_5C5A6zmIS72vkF-tX8Do_EgFYP9Oj-b-JsuJBa_kpXaKDE-9ggAqV03ll-AaMXjKtTgPlIp8-Fws1H_JkV-vcfsZODUaqTx8JmdgKPWVh8IYCJbcnR1atA5K83N59jBorEau7VeX_jNTB3Cy7DQuCaDX3YyIjwd-6k Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:57:01.101885 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2a6a637072b04667a3f21da9c57325c0 Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. Sep 07 14:57:01.103686 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9431d0e2-c490-480a-ad68-6d1ea094bf1f'} Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:57:01.104799 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. Sep 07 14:57:01.106519 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.108164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Returning 404 to user: Instance 9431d0e2-c490-480a-ad68-6d1ea094bf1f could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:57:01.108164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-380b011c-cf5d-4cc5-9f89-887f94269def tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f" status: 404 len: 111 microversion: 2.1 time: 0.030448 Sep 07 14:57:01.108164 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 635/1243] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:57:01 2022] GET /compute/v2.1/servers/9431d0e2-c490-480a-ad68-6d1ea094bf1f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:57:01.624531 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:57:01.625060 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.compute.api [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127537) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:57:01.631464 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.633237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.633237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.633237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.633699 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.634128 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG oslo_concurrency.lockutils [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127537) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.650931 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.wsgi [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] HTTP exception thrown: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Request method failure captured: Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: request: DELETE /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b HTTP/1.1 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept: application/json Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Accept-Encoding: identity Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Connection: close Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Length: 0 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Content-Type: application/json Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Host: 10.222.0.57 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: Openstack-System-Scope: None Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: User-Agent: python-urllib3/1.26.12 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Auth-Token: gAAAAABjGK9-os36cXsg_5C5A6zmIS72vkF-tX8Do_EgFYP9Oj-b-JsuJBa_kpXaKDE-9ggAqV03ll-AaMXjKtTgPlIp8-Fws1H_JkV-vcfsZODUaqTx8JmdgKPWVh8IYCJbcnR1atA5K83N59jBorEau7VeX_jNTB3Cy7DQuCaDX3YyIjwd-6k Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Id: None Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Domain-Name: None Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Identity-Status: Confirmed Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Is-Admin-Project: True Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Id: default Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Domain-Name: Default Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Project-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Role: reader,member Sep 07 14:57:01.652621 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Roles: reader,member Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-Tenant-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Id: default Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Domain-Name: Default Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Id: 2a6a637072b04667a3f21da9c57325c0 Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: X-User-Name: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: method: > Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: exception: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.654237 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: action_args: {'id': '9e91d7cf-ac5c-47f0-9b62-c666ce07c34b'} Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:57:01.655123 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.656656 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.658840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Returning 404 to user: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. {{(pid=127537) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:57:01.658840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-a4dfc918-702b-4f73-bb7f-8c5b7607002b tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "DELETE /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 404 len: 111 microversion: 2.1 time: 0.033651 Sep 07 14:57:01.658840 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 609/1244] 10.222.0.57 () {58 vars in 1239 bytes} [Wed Sep 7 14:57:01 2022] DELETE /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:57:01.662889 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '>' {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:57:01.664137 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.compute.api [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] [instance: 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b] Fetching instance by UUID {{(pid=127536) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 07 14:57:01.670149 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.670630 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.671058 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.671747 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Acquiring lock "57904cc0-13ce-49a9-850c-a6dec6864e14" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 07 14:57:01.672287 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 07 14:57:01.672718 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG oslo_concurrency.lockutils [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Lock "57904cc0-13ce-49a9-850c-a6dec6864e14" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=127536) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 07 14:57:01.685892 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.wsgi [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] HTTP exception thrown: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Request method failure captured: Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: request: GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b HTTP/1.1 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept: application/json Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Accept-Encoding: identity Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Connection: close Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Length: 0 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Content-Type: application/json Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Host: 10.222.0.57 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: Openstack-System-Scope: None Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: User-Agent: python-urllib3/1.26.12 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Auth-Token: gAAAAABjGK9-os36cXsg_5C5A6zmIS72vkF-tX8Do_EgFYP9Oj-b-JsuJBa_kpXaKDE-9ggAqV03ll-AaMXjKtTgPlIp8-Fws1H_JkV-vcfsZODUaqTx8JmdgKPWVh8IYCJbcnR1atA5K83N59jBorEau7VeX_jNTB3Cy7DQuCaDX3YyIjwd-6k Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Id: None Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Domain-Name: None Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Identity-Status: Confirmed Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Is-Admin-Project: True Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Id: default Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Domain-Name: Default Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Project-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Role: reader,member Sep 07 14:57:01.687361 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Roles: reader,member Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/image"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57:9696/networking"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/identity"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.57:8080", "publicURL": "http://10.222.0.57:8080/v1/AUTH_5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/volume/v3/5c7b26a4966c4c309d058d1d19d5d553"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.57/placement"}]}] Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Id: 5c7b26a4966c4c309d058d1d19d5d553 Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-Tenant-Name: tempest-TestVolumeBootPattern-741965744 Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Id: default Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Domain-Name: Default Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Id: 2a6a637072b04667a3f21da9c57325c0 Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: X-User-Name: tempest-TestVolumeBootPattern-741965744-project Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: method: > Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: exception: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.692200 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: action_args: {'id': '9e91d7cf-ac5c-47f0-9b62-c666ce07c34b'} Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: {{(pid=127536) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 07 14:57:01.693276 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. Sep 07 14:57:01.694944 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: ERROR nova.api.openstack.wsgi Sep 07 14:57:01.696619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: DEBUG nova.api.openstack.wsgi [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Returning 404 to user: Instance 9e91d7cf-ac5c-47f0-9b62-c666ce07c34b could not be found. {{(pid=127536) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 07 14:57:01.696619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: INFO nova.api.openstack.requestlog [None req-6917e218-3b98-409f-9d90-e9e9bf957e48 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b" status: 404 len: 111 microversion: 2.1 time: 0.029682 Sep 07 14:57:01.696619 dv-cinder-801354-8-iscsi devstack@n-api.service[127536]: [pid: 127536|app: 0|req: 636/1245] 10.222.0.57 () {58 vars in 1236 bytes} [Wed Sep 7 14:57:01 2022] GET /compute/v2.1/servers/9e91d7cf-ac5c-47f0-9b62-c666ce07c34b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 07 14:57:03.209326 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: DEBUG nova.api.openstack.wsgi [None req-6ed34829-b36b-4913-9f9e-b2eb977ee114 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] Calling method '.version_select at 0x7fefdf9515e0>' {{(pid=127537) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 07 14:57:03.280599 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: INFO nova.api.openstack.requestlog [None req-6ed34829-b36b-4913-9f9e-b2eb977ee114 tempest-TestVolumeBootPattern-741965744 tempest-TestVolumeBootPattern-741965744-project] 10.222.0.57 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-135479397" status: 202 len: 0 microversion: 2.1 time: 0.075300 Sep 07 14:57:03.281310 dv-cinder-801354-8-iscsi devstack@n-api.service[127537]: [pid: 127537|app: 0|req: 610/1246] 10.222.0.57 () {58 vars in 1260 bytes} [Wed Sep 7 14:57:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-135479397 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)